Sep 20 16:42:42 devstack cinder-volume[74971]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 20 16:42:42 devstack cinder-volume[74971]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 20 16:42:42 devstack cinder-volume[74971]: we strongly recommend against using it for new projects.
Sep 20 16:42:42 devstack cinder-volume[74971]: If you are already using Eventlet, we recommend migrating to a different
Sep 20 16:42:42 devstack cinder-volume[74971]: framework.  For more detail see
Sep 20 16:42:42 devstack cinder-volume[74971]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 20 16:42:42 devstack cinder-volume[74971]:   import eventlet  # noqa
Sep 20 16:42:44 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:42:44 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:42:44 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:42:45 devstack cinder-volume[74971]: INFO dbcounter [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Registered counter for database cinder
Sep 20 16:42:45 devstack cinder-volume[74971]: DEBUG oslo_db.sqlalchemy.engines [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG dbcounter [-] [74971] Writer thread running {{(pid=74971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.rpc [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.rpc [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_db.sqlalchemy.engines [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.volume.manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Determined volume DB was empty at startup.
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG cinder.volume.manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74971) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.volume.manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 20 16:42:46 devstack cinder-volume[74971]: WARNING stevedore.named [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 20 16:42:46 devstack cinder-volume[74971]: WARNING castellan.key_manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:42:46 devstack cinder-volume[74971]: WARNING cinder.keymgr.conf_key_mgr [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG cinder.volume.drivers.lvm [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74971) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_concurrency.processutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_concurrency.processutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=74971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_db.sqlalchemy.engines [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.rpc [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.rpc [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 20 16:42:46 devstack cinder-volume[74971]: WARNING stevedore.named [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 20 16:42:46 devstack cinder-volume[74971]: WARNING castellan.key_manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO cinder.volume.manager [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_db.sqlalchemy.engines [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:42:46 devstack cinder-volume[74971]: INFO oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Starting 1 workers
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Started child 75132 {{(pid=74971) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Full set of CONF: {{(pid=74971) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] ******************************************************************************** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Configuration options gathered from: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] ================================================================================ {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] allow_availability_zone_fallback = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] allow_compression_on_image_upload = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] allowed_direct_url_schemes     = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] api_rate_limit                 = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] auth_strategy                  = keystone {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[75132]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] az_cache_duration              = 3600 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_availability_zone      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_host                   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_name                   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_stats_polling_interval = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backup_api_class               = cinder.backup.api.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backup_name_template           = backup-%s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backup_use_same_host           = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backup_use_temp_snapshot       = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] chap_password                  = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] chap_username                  =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_internal_tenant_project_id = 4902a7df80a24fcab6458e91a226a717 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_internal_tenant_user_id = c2773a675fee477d9f9ca1c7ad6cdf34 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cloned_volume_same_az          = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cluster                        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] compression_format             = gzip {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] compute_api_class              = cinder.compute.nova.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] config_dir                     = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] config_source                  = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] control_exchange               = openstack {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] debug                          = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] default_availability_zone      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] default_group_type             = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] default_volume_type            = lvmdriver-1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] disk_geometry                  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_client_cert             = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_client_cert_key         = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_data_namespace          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_ssl_cert_path           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_ssl_cert_verify         = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] driver_use_ssl                 = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] enable_force_upload            = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] enable_new_services            = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] enable_unsupported_driver      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] enforce_multipath_for_image_xfer = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] filter_function                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_api_insecure            = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_api_servers             = ['http://192.168.122.139/image'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_api_ssl_compression     = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_ca_certificates_file    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_catalog_info            = image:glance:publicURL {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_certfile                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_keyfile                 = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_num_retries             = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance_request_timeout         = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] goodness_function              = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] graceful_shutdown_timeout      = 5 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] group_api_class                = cinder.group.api.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:46 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] host                           = devstack {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_compress_on_upload       = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_conversion_address_space_limit = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_conversion_cpu_limit     = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_conversion_disable       = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_upload_use_cinder_backend = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_upload_use_internal_tenant = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_volume_cache_enabled     = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_volume_cache_max_count   = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] image_volume_cache_max_size_gb = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] init_host_max_objects_retrieval = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] instance_format                = [instance: %(uuid)s]  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iscsi_target_flags             =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iscsi_write_cache              = on {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iser_helper                    = tgtadm {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iser_ip_address                = 192.168.122.139 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iser_port                      = 3260 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_color                      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_config_append              = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_dir                        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_file                       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_options                    = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_rotate_interval            = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_rotate_interval_type       = days {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] log_rotation_type              = none {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] max_age                        = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] max_logfile_count              = 30 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] max_logfile_size_mb            = 200 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] max_over_subscription_ratio    = 20.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] message_reap_interval          = 86400 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] message_ttl                    = 2592000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] migration_create_volume_timeout_secs = 300 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] monkey_patch                   = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] monkey_patch_modules           = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] my_ip                          = 192.168.122.139 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] no_snapshot_gb_quota           = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] num_iser_scan_tries            = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] num_shell_tries                = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] num_volume_device_scan_tries   = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] nvmeof_conn_info_version       = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] nvmet_ns_id                    = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] nvmet_port_id                  = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_max_limit                = 1000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_ext_list          = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_listen_port       = 8776 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_use_ssl           = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] osapi_volume_workers           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] per_volume_size_limit          = -1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] periodic_fuzzy_delay           = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] periodic_interval              = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] public_endpoint                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] publish_errors                 = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_backup_gigabytes         = 1000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_backups                  = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_gigabytes                = 1000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_groups                   = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_snapshots                = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] quota_volumes                  = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] rate_limit_burst               = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] rate_limit_except_level        = CRITICAL {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] rate_limit_interval            = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] reinit_driver_count            = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] replication_device             = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] report_discard_supported       = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] report_interval                = 120 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] reservation_clean_interval     = 86400 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] reservation_expire             = 86400 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] reserved_image_namespaces      = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] reserved_percentage            = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] rpc_response_timeout           = 120 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] run_external_periodic_tasks    = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] scst_target_driver             = iscsi {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] scst_target_iqn_name           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_down_time              = 720 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] shell_completion               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] snapshot_name_template         = snapshot-%s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] snapshot_same_host             = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] split_loggers                  = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] state_path                     = /opt/stack/data/cinder {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] storage_availability_zone      = nova {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] storage_protocol               = iSCSI {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] syslog_log_facility            = LOG_USER {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_helper                  = lioadm {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_ip_address              = 192.168.122.139 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_port                    = 3260 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_protocol                = iscsi {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] target_secondary_ip_addresses  = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] trace_flags                    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] transport_url                  = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] until_refresh                  = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_chap_auth                  = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_default_quota_class        = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_journal                    = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_json                       = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_multipath_for_image_xfer   = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_stderr                     = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] use_syslog                     = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] verify_glance_signatures       = enabled {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_api_class               = cinder.volume.api.API {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_backend_name            = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_clear                   = zero {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_clear_ionice            = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_clear_size              = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_copy_bps_limit          = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_dd_blocksize            = 1M {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_name_template           = volume-%s {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_service_inithost_offload = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volume_usage_audit_period      = month {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] zoning_mode                    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_concurrency.disable_process_locking = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.auth_section = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.auth_type   = password {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.auth_version = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.cache       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.certfile    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.delay_auth_decision = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.http_connect_timeout = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.include_service_catalog = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.insecure    = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.interface   = public {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.keyfile     = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_password = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcache_username = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.region_name = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.service_token_roles_required = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.service_type = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.token_cache_time = 300 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.backend                  = dogpile.cache.null {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.backend_argument         = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.backend_expiration_time  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.config_prefix            = cache.oslo {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.debug_cache_backend      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.enable_retry_client      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.enable_socket_keepalive  = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.enabled                  = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.expiration_time          = 600 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.hashclient_retry_attempts = 2 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_dead_retry      = 300 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_pool_maxsize    = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_sasl_enabled    = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.password                 = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.proxies                  = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.redis_db                 = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.redis_sentinel_service_name = mymaster {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.redis_server             = localhost:6379 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.retry_attempts           = 2 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.retry_delay              = 0.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.socket_keepalive_count   = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.socket_keepalive_idle    = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.socket_keepalive_interval = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.socket_timeout           = 1.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.tls_allowed_ciphers      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.tls_cafile               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.tls_certfile             = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.tls_enabled              = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.tls_keyfile              = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cache.username                 = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] coordination.backend_url       = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.asyncio_connection    = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.asyncio_slave_connection = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.backend               = sqlalchemy {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.connection            = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.connection_debug      = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.connection_parameters =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.connection_recycle_time = 3600 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.connection_trace      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.db_inc_retry_interval = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.db_max_retries        = 20 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.db_max_retry_interval = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack sudo[75136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack sudo[75136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.db_retry_interval     = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.max_overflow          = 50 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.max_pool_size         = 5 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.max_retries           = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.mysql_wsrep_sync_wait = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.pool_timeout          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.retry_interval        = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.slave_connection      = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.sqlite_synchronous    = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.synchronous_reader    = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] database.use_db_reconnect      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_tracing.insecure = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.connection_string     = messaging:// {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.enabled               = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.es_doc_type           = notification {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.es_scroll_size        = 10000 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.es_scroll_time        = 2m {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.filter_error_trace    = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.hmac_keys             = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.sentinel_service_name = mymaster {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.socket_timeout        = 0.1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.trace_requests        = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler.trace_sqlalchemy      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler_jaeger.process_tags   = {} {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler_jaeger.service_name_prefix = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] profiler_otlp.service_name_prefix = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.enforce_new_defaults = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.policy_default_rule = default {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.policy_file        = policy.yaml {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.group          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.helper_command = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] privsep_osbrick.user           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.group         = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.helper_command = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] cinder_sys_admin.user          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.auth_section      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.auth_type         = password {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.cafile            = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.certfile          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.collect_timing    = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.insecure          = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.keyfile           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.send_service_user_token = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.split_loggers     = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.timeout           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.tls_ciphers       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] service_user.tls_min_version   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.auth_section            = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.auth_type               = password {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.certfile                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.collect_timing          = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.insecure                = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.keyfile                 = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.region_name             = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.split_loggers           = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.timeout                 = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.tls_ciphers             = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] glance.tls_min_version         = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.backend_availability_zone = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.chap_password = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.chap_username =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.disk_geometry = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_client_cert = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_client_cert_key = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_data_namespace = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.driver_use_ssl = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.enable_unsupported_driver = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.extra_capabilities = {} {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.filter_function = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.goodness_function = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iscsi_target_flags =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iscsi_write_cache = on {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iser_helper   = tgtadm {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iser_port     = 3260 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.lvm_share_target = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.lvm_type      = auto {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.num_shell_tries = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.nvmet_port_id = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.replication_device = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.report_discard_supported = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.reserved_percentage = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.scst_target_driver = iscsi {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.scst_target_iqn_name = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.storage_protocol = iSCSI {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_helper = tgtadm {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_port   = 3260 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_protocol = iscsi {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.trace_flags   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.unique_fqdn_network = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.use_chap_auth = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_backend_name = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_clear  = zero {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_clear_ionice = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_clear_size = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_reports.file_event_handler = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_reports.log_dir           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.backend_availability_zone = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.backend_host       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.chap_password      = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.chap_username      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.disk_geometry      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_client_cert = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_data_namespace = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.extra_capabilities = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.filter_function    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.goodness_function  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iser_helper        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iser_ip_address    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iser_port          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.iser_target_prefix = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.lvm_share_target   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.lvm_type           = auto {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.num_shell_tries    = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.replication_device = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.report_discard_supported = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.reserved_percentage = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.scst_target_driver = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.storage_protocol   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_helper      = lioadm {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_ip_address  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_port        = 3260 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.trace_flags        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.use_chap_auth      = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_clear       = zero {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_clear_size  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] lvmdriver-1.volumes_dir        = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl      = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_notifications.driver = [] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_notifications.retry = -1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] oslo_messaging_notifications.transport_url = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] key_manager.fixed_key          = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.barbican_api_version  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.barbican_endpoint     = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.barbican_endpoint_type = public {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.barbican_region_name  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.cafile                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.certfile              = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.collect_timing        = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.insecure              = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.keyfile               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.number_of_retries     = 60 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.retry_delay           = 1 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.send_service_user_token = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.split_loggers         = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.timeout               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.tls_ciphers           = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.tls_min_version       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.verify_ssl            = True {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican.verify_ssl_path       = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.auth_section = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.auth_type = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.cafile   = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.certfile = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.collect_timing = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.insecure = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.keyfile  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.split_loggers = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.timeout  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.tls_ciphers = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] barbican_service_user.tls_min_version = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.approle_role_id          = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.approle_secret_id        = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.auth_method              = approle {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.auth_path                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.kv_mountpoint            = secret {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.kv_path                  = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.kv_version               = 2 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.namespace                = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.root_token_id            = **** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.ssl_ca_crt_file          = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.timeout                  = 60.0 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.token_file               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.token_role               = None {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.use_ssl                  = False {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:42:47 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] ******************************************************************************** {{(pid=74971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 20 16:42:47 devstack sudo[75136]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack sudo[75144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:47 devstack sudo[75144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:47 devstack sudo[75144]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:42:47 devstack cinder-volume[75132]: INFO cinder.brick.local_dev.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack sudo[75148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:47 devstack sudo[75148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:47 devstack sudo[75148]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG cinder.brick.local_dev.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75132) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 20 16:42:47 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:47 devstack sudo[75223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:47 devstack sudo[75223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:48 devstack sudo[75223]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:48 devstack sudo[75458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:48 devstack sudo[75458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:48 devstack sudo[75458]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:48 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:48 devstack sudo[75570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 20 16:42:48 devstack sudo[75570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:49 devstack sudo[75570]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.273s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:49 devstack sudo[75660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:49 devstack sudo[75660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:49 devstack sudo[75660]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:49 devstack sudo[75752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:49 devstack sudo[75752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:49 devstack sudo[75752]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:49 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:49 devstack sudo[75755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:49 devstack sudo[75755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:50 devstack sudo[75755]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack sudo[75838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:50 devstack sudo[75838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:50 devstack sudo[75838]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack sudo[75848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:50 devstack sudo[75848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:50 devstack sudo[75848]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: INFO cinder.volume.drivers.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack sudo[75932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:50 devstack sudo[75932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:50 devstack sudo[75932]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:42:50 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:50 devstack sudo[75935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:50 devstack sudo[75935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:51 devstack sudo[75935]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:51 devstack sudo[75938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:51 devstack sudo[75938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:51 devstack sudo[75938]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:51 devstack sudo[75947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:51 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:51 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:51 devstack sudo[75950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:51 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:52 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:52 devstack cinder-volume[75132]: INFO cinder.volume.driver [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Driver hasn't implemented _init_vendor_properties()
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG cinder.volume.driver [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75132) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_db.sqlalchemy.engines [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writer thread running {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG cinder.db.api [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Building query based on filter {{(pid=75132) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3953}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG cinder.image.image_utils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75132) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 20 16:42:52 devstack cinder-volume[75132]: INFO cinder.keymgr.migration [None req-c088c673-f0a2-4b2b-8dd2-e1d60fd539ca None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:52 devstack sudo[75954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:52 devstack sudo[75954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:52 devstack sudo[75954]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:52 devstack sudo[75960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:52 devstack sudo[75960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:52 devstack sudo[75960]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:52 devstack sudo[75963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:52 devstack sudo[75963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:53 devstack sudo[75963]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:53 devstack sudo[75968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:53 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:53 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG cinder.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Notifying Schedulers of capabilities ... {{(pid=75132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:42:53 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Driver initialization completed successfully.
Sep 20 16:42:53 devstack cinder-volume[75132]: INFO cinder.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Initiating service 2 cleanup
Sep 20 16:42:53 devstack cinder-volume[75132]: INFO cinder.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Service 2 cleanup completed.
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG cinder.service [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Creating RPC server for service cinder-volume {{(pid=75132) start /opt/stack/cinder/cinder/service.py:231}}
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG cinder.service [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75132) start /opt/stack/cinder/cinder/service.py:237}}
Sep 20 16:42:53 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:53 devstack sudo[75971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:42:53 devstack sudo[75971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:53 devstack sudo[75971]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:53 devstack sudo[75976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:53 devstack sudo[75976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:54 devstack sudo[75976]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:54 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:54 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:54 devstack sudo[75979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:42:54 devstack sudo[75979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:54 devstack sudo[75979]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:54 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:54 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:42:54 devstack sudo[75982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:42:54 devstack sudo[75982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:42:54 devstack sudo[75982]: pam_unix(sudo:session): session closed for user root
Sep 20 16:42:54 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:42:54 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-2734b6cc-c05b-44b6-9224-eb0dc4256dca None None] Driver post RPC initialization completed successfully.
Sep 20 16:42:56 devstack cinder-volume[74971]: DEBUG dbcounter [-] [74971] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:43:03 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:SELECT=2 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:43:04 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:43:31 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager._thread_info {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:43:31 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread count: 6 {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:43:31 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread info: [<_MainThread(MainThread, started 133990687395968)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133990572571904)>, <Thread(Thread-3 (stat_writer), started daemon 133990572562880)>, <Thread(Rabbit-heartbeat, started daemon 133990571892416)>, <Thread(Thread-5 (_runner), started daemon 133990571940992)>, <Thread(Thread-7 (_runner), started daemon 133990569979008)>] {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:44:31 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:44:31 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:44:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:44:31 devstack sudo[81172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:44:31 devstack sudo[81172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:44:31 devstack sudo[81172]: pam_unix(sudo:session): session closed for user root
Sep 20 16:44:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:44:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:44:31 devstack sudo[81175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:44:31 devstack sudo[81175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:44:32 devstack sudo[81175]: pam_unix(sudo:session): session closed for user root
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:44:32 devstack sudo[81178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:44:32 devstack sudo[81178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:44:32 devstack sudo[81178]: pam_unix(sudo:session): session closed for user root
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:44:32 devstack sudo[81181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:44:32 devstack sudo[81181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:44:32 devstack sudo[81181]: pam_unix(sudo:session): session closed for user root
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG cinder.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Notifying Schedulers of capabilities ... {{(pid=75132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager._thread_info {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread count: 6 {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:44:32 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread info: [<_MainThread(MainThread, started 133990687395968)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133990572571904)>, <Thread(Thread-3 (stat_writer), started daemon 133990572562880)>, <Thread(Rabbit-heartbeat, started daemon 133990571892416)>, <Thread(Thread-5 (_runner), started daemon 133990571940992)>, <Thread(Thread-7 (_runner), started daemon 133990569979008)>] {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:45:04 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:SELECT=1 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:45:04 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:UPDATE=1 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:45:31 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:45:31 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:45:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:45:31 devstack sudo[82712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:45:31 devstack sudo[82712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:45:31 devstack sudo[82712]: pam_unix(sudo:session): session closed for user root
Sep 20 16:45:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:45:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:45:31 devstack sudo[82736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:45:31 devstack sudo[82736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:45:32 devstack sudo[82736]: pam_unix(sudo:session): session closed for user root
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:45:32 devstack sudo[82741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:45:32 devstack sudo[82741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:45:32 devstack sudo[82741]: pam_unix(sudo:session): session closed for user root
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:45:32 devstack sudo[82755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:45:32 devstack sudo[82755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:45:32 devstack sudo[82755]: pam_unix(sudo:session): session closed for user root
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG cinder.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Notifying Schedulers of capabilities ... {{(pid=75132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager._thread_info {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread count: 6 {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:45:32 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] thread info: [<_MainThread(MainThread, started 133990687395968)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133990572571904)>, <Thread(Thread-3 (stat_writer), started daemon 133990572562880)>, <Thread(Rabbit-heartbeat, started daemon 133990571892416)>, <Thread(Thread-5 (_runner), started daemon 133990571940992)>, <Thread(Thread-7 (_runner), started daemon 133990569979008)>] {{(pid=75132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:46:31 devstack cinder-volume[75132]: DEBUG oslo_service.periodic_task [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:46:31 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Updating volume stats {{(pid=75132) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 20 16:46:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:46:31 devstack sudo[84236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 20 16:46:31 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:46:31 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root
Sep 20 16:46:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:46:31 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:46:31 devstack sudo[84242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:46:31 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:46:32 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:46:32 devstack sudo[84245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 20 16:46:32 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:46:32 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:46:32 devstack sudo[84257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 20 16:46:32 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:46:32 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:46:32 devstack cinder-volume[75132]: DEBUG cinder.manager [None req-b5428b90-6db1-47f6-b43f-21bd30879b65 None None] Notifying Schedulers of capabilities ... {{(pid=75132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:47:04 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:SELECT=1 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:47:04 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:UPDATE=1 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:47:10 devstack cinder-volume[74971]: INFO oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Caught SIGTERM, stopping children
Sep 20 16:47:10 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Acquiring lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:10 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Acquired lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:10 devstack cinder-volume[74971]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Releasing lock "singleton_lock" {{(pid=74971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:10 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Stop services. {{(pid=74971) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 20 16:47:10 devstack cinder-volume[74971]: DEBUG oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Killing children. {{(pid=74971) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 20 16:47:10 devstack cinder-volume[74971]: INFO oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Waiting on 1 children to exit
Sep 20 16:47:13 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Acquiring lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:13 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Acquired lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:13 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Releasing lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:13 devstack cinder-volume[75132]: WARNING amqp [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 20 16:47:13 devstack cinder-volume[75132]: WARNING amqp [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 20 16:47:13 devstack cinder-volume[74971]: INFO oslo_service.backend._eventlet.service [None req-a50f91bd-17e7-4e97-9de8-f6fbf0bb5e4a None None] Child 75132 exited with status 0
Sep 20 16:47:13 devstack cinder-volume[85118]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 20 16:47:13 devstack cinder-volume[85118]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 20 16:47:13 devstack cinder-volume[85118]: we strongly recommend against using it for new projects.
Sep 20 16:47:13 devstack cinder-volume[85118]: If you are already using Eventlet, we recommend migrating to a different
Sep 20 16:47:13 devstack cinder-volume[85118]: framework.  For more detail see
Sep 20 16:47:13 devstack cinder-volume[85118]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 20 16:47:13 devstack cinder-volume[85118]:   import eventlet  # noqa
Sep 20 16:47:15 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:15 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:15 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:16 devstack cinder-volume[85118]: INFO dbcounter [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Registered counter for database cinder
Sep 20 16:47:16 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:16 devstack cinder-volume[85118]: DEBUG dbcounter [-] [85118] Writer thread running {{(pid=85118) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:47:16 devstack cinder-volume[85118]: INFO cinder.rpc [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 20 16:47:16 devstack cinder-volume[85118]: INFO cinder.rpc [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 20 16:47:16 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:16 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Determined volume DB was empty at startup.
Sep 20 16:47:16 devstack cinder-volume[85118]: DEBUG cinder.volume.manager [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85118) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 20 16:47:16 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 20 16:47:16 devstack cinder-volume[85118]: WARNING stevedore.named [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 20 16:47:16 devstack cinder-volume[85118]: WARNING castellan.key_manager [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:47:16 devstack cinder-volume[85118]: WARNING cinder.keymgr.conf_key_mgr [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:47:17 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:17 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Starting 1 workers
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Started child 85317 {{(pid=85118) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Full set of CONF: {{(pid=85118) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] ******************************************************************************** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Configuration options gathered from: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] ================================================================================ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] allow_availability_zone_fallback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] allow_compression_on_image_upload = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85317]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] allowed_direct_url_schemes     = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] api_rate_limit                 = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] auth_strategy                  = keystone {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_availability_zone      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_host                   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_name                   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_stats_polling_interval = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backup_api_class               = cinder.backup.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backup_name_template           = backup-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backup_use_same_host           = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backup_use_temp_snapshot       = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] chap_password                  = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] chap_username                  =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_internal_tenant_project_id = 4902a7df80a24fcab6458e91a226a717 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_internal_tenant_user_id = c2773a675fee477d9f9ca1c7ad6cdf34 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cluster                        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] compression_format             = gzip {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] config_dir                     = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] config_source                  = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] control_exchange               = openstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] debug                          = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] default_availability_zone      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] default_group_type             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] default_volume_type            = QuobyteHD {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] disk_geometry                  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_client_cert             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_client_cert_key         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_data_namespace          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_ssl_cert_path           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_ssl_cert_verify         = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] driver_use_ssl                 = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] enable_new_services            = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] enable_unsupported_driver      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] enforce_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] filter_function                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_api_insecure            = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_api_servers             = ['http://192.168.122.139/image'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_api_ssl_compression     = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_ca_certificates_file    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_certfile                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_keyfile                 = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_num_retries             = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance_request_timeout         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] goodness_function              = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] graceful_shutdown_timeout      = 5 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] group_api_class                = cinder.group.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] host                           = devstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_compress_on_upload       = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_conversion_address_space_limit = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_conversion_cpu_limit     = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_conversion_disable       = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_upload_use_cinder_backend = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_upload_use_internal_tenant = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_volume_cache_enabled     = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_volume_cache_max_count   = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] image_volume_cache_max_size_gb = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] init_host_max_objects_retrieval = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iscsi_target_flags             =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iscsi_write_cache              = on {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iser_helper                    = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iser_ip_address                = 192.168.122.139 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iser_port                      = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_color                      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_config_append              = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_dir                        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_file                       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_options                    = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_rotate_interval            = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_rotate_interval_type       = days {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] log_rotation_type              = none {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] max_age                        = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] max_logfile_count              = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] max_logfile_size_mb            = 200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85317]: INFO cinder.volume.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Starting volume driver QuobyteDriver (1.1.14)
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.remotefs [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85317) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] max_over_subscription_ratio    = 20.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] message_reap_interval          = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] message_ttl                    = 2592000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] migration_create_volume_timeout_secs = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] monkey_patch                   = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] monkey_patch_modules           = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] my_ip                          = 192.168.122.139 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] no_snapshot_gb_quota           = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] num_iser_scan_tries            = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] num_shell_tries                = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] num_volume_device_scan_tries   = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] nvmeof_conn_info_version       = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] nvmet_ns_id                    = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] nvmet_port_id                  = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_max_limit                = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_ext_list          = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_listen_port       = 8776 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_use_ssl           = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] osapi_volume_workers           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] per_volume_size_limit          = -1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] periodic_fuzzy_delay           = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] periodic_interval              = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] public_endpoint                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] publish_errors                 = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_backup_gigabytes         = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_backups                  = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_gigabytes                = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_groups                   = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_snapshots                = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] quota_volumes                  = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] rate_limit_burst               = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] rate_limit_except_level        = CRITICAL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] rate_limit_interval            = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] reinit_driver_count            = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] replication_device             = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] report_discard_supported       = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] report_interval                = 120 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] reservation_clean_interval     = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] reservation_expire             = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] reserved_image_namespaces      = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] reserved_percentage            = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] rpc_response_timeout           = 120 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] run_external_periodic_tasks    = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] scst_target_driver             = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] scst_target_iqn_name           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_down_time              = 720 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] shell_completion               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] snapshot_name_template         = snapshot-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] split_loggers                  = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] state_path                     = /opt/stack/data/cinder {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] storage_availability_zone      = nova {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] storage_protocol               = iSCSI {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] syslog_log_facility            = LOG_USER {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_helper                  = lioadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_ip_address              = 192.168.122.139 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_port                    = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_protocol                = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] target_secondary_ip_addresses  = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] trace_flags                    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] transport_url                  = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] until_refresh                  = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_chap_auth                  = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_default_quota_class        = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_journal                    = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_json                       = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_multipath_for_image_xfer   = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_stderr                     = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] use_syslog                     = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] verify_glance_signatures       = enabled {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_api_class               = cinder.volume.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_backend_name            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_clear                   = zero {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_clear_ionice            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_clear_size              = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_copy_bps_limit          = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_dd_blocksize            = 1M {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_name_template           = volume-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_service_inithost_offload = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volume_usage_audit_period      = month {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] zoning_mode                    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_concurrency.disable_process_locking = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.auth_type   = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.auth_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.cache       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.certfile    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.include_service_catalog = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.insecure    = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.interface   = public {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.keyfile     = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcache_username = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.region_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.service_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.backend                  = dogpile.cache.null {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.backend_argument         = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.backend_expiration_time  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.config_prefix            = cache.oslo {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.debug_cache_backend      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.enable_retry_client      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.enable_socket_keepalive  = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.enabled                  = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.expiration_time          = 600 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.hashclient_retry_attempts = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_dead_retry      = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_sasl_enabled    = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.password                 = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.proxies                  = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.redis_db                 = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.redis_server             = localhost:6379 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.retry_attempts           = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.retry_delay              = 0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.socket_keepalive_count   = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.socket_keepalive_idle    = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.socket_keepalive_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.socket_timeout           = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.tls_allowed_ciphers      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.tls_cafile               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.tls_certfile             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.tls_enabled              = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.tls_keyfile              = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cache.username                 = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] coordination.backend_url       = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.asyncio_connection    = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.asyncio_slave_connection = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.backend               = sqlalchemy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.connection            = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.connection_debug      = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.connection_parameters =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.connection_recycle_time = 3600 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.connection_trace      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.db_inc_retry_interval = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.db_max_retries        = 20 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.db_max_retry_interval = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.db_retry_interval     = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.max_overflow          = 50 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.max_pool_size         = 5 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.max_retries           = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.mysql_wsrep_sync_wait = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.pool_timeout          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.retry_interval        = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.slave_connection      = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.sqlite_synchronous    = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.synchronous_reader    = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] database.use_db_reconnect      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85317) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Sep 20 16:47:17 devstack cinder-volume[85317]: WARNING cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 20 16:47:17 devstack cinder-volume[85317]: WARNING cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_tracing.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.connection_string     = messaging:// {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.enabled               = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.es_doc_type           = notification {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.es_scroll_size        = 10000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.es_scroll_time        = 2m {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.filter_error_trace    = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.hmac_keys             = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.sentinel_service_name = mymaster {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.socket_timeout        = 0.1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.trace_requests        = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler.trace_sqlalchemy      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler_jaeger.process_tags   = {} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler_jaeger.service_name_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] profiler_otlp.service_name_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.enforce_new_defaults = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.policy_default_rule = default {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.group          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.helper_command = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] privsep_osbrick.user           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.group         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.helper_command = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] cinder_sys_admin.user          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.auth_section      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.auth_type         = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.cafile            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.certfile          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.collect_timing    = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.insecure          = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.keyfile           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.send_service_user_token = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.split_loggers     = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.timeout           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.tls_ciphers       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] service_user.tls_min_version   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.auth_section            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.auth_type               = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.certfile                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.collect_timing          = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.insecure                = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.keyfile                 = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.region_name             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.split_loggers           = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.timeout                 = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.tls_ciphers             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] glance.tls_min_version         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.backend_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.chap_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.chap_username =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.disk_geometry = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_client_cert = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_client_cert_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_data_namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.driver_use_ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.extra_capabilities = {} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.filter_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.goodness_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iscsi_target_flags =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iscsi_write_cache = on {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iser_port     = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_host      =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_login     = admin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_mount_options = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_password  = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_private_key =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_share_path =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.num_shell_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.quobyte_volume_url = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.replication_device = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.report_discard_supported = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.reserved_percentage = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_helper = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_port   = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_protocol = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.trace_flags   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.unique_fqdn_network = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.use_chap_auth = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_backend_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_clear  = zero {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_clear_ionice = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_clear_size = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_reports.file_event_handler = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_reports.log_dir           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.backend_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.backend_host         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.chap_password        = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.chap_username        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.disk_geometry        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_client_cert   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_data_namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.extra_capabilities   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.filter_function      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.goodness_function    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iser_helper          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iser_ip_address      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iser_port            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_host             = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_login            = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_mount_options    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_password         = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_private_key      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_share_path       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.num_shell_tries      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.replication_device   = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.report_discard_supported = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.reserved_percentage  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.scst_target_driver   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.storage_protocol     = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_helper        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_ip_address    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_port          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_prefix        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_protocol      = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.trace_flags          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.use_chap_auth        = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_clear         = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_clear_size    = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] QuobyteHD.volumes_dir          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_notifications.driver = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_notifications.retry = -1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] key_manager.fixed_key          = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.barbican_api_version  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.barbican_endpoint     = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.barbican_endpoint_type = public {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.barbican_region_name  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.cafile                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.certfile              = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.collect_timing        = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.insecure              = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.keyfile               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.number_of_retries     = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.retry_delay           = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.send_service_user_token = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.split_loggers         = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.timeout               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.tls_ciphers           = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.tls_min_version       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.verify_ssl            = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican.verify_ssl_path       = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.auth_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.cafile   = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.collect_timing = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.keyfile  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.timeout  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.tls_ciphers = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] barbican_service_user.tls_min_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.approle_role_id          = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.approle_secret_id        = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.auth_method              = approle {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.auth_path                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.kv_mountpoint            = secret {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.kv_path                  = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.kv_version               = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.namespace                = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.root_token_id            = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.ssl_ca_crt_file          = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.timeout                  = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.token_file               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.token_role               = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.use_ssl                  = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:17 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] ******************************************************************************** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 20 16:47:17 devstack quobyte-client[85333]: Reading configuration file: /etc/quobyte/client.cfg
Sep 20 16:47:17 devstack quobyte-client[85333]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] CMD "mount.quobyte" returned: 1 in 0.177s {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:17 devstack cinder-volume[85317]: INFO cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 ...
Sep 20 16:47:17 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 -c /etc/quobyte/client-cinder.cfg {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:17 devstack sudo[85334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 -c /etc/quobyte/client-cinder.cfg
Sep 20 16:47:17 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:18 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.430s {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 succeeded
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.439s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:18 devstack sudo[85437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:18 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:18 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.246s {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.volume.driver [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Driver hasn't implemented _init_vendor_properties()
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.driver [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6770935058594, 'free_capacity_gb': 1775.6770935058594, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85317) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_db.sqlalchemy.engines [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG dbcounter [-] [85317] Writer thread running {{(pid=85317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.db.api [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Building query based on filter {{(pid=85317) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3953}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.image.image_utils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85317) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.keymgr.migration [None req-7c32021e-d093-49ba-a272-52019e47de2b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:18 devstack sudo[85441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:18 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:18 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.242s {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Notifying Schedulers of capabilities ... {{(pid=85317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.volume.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Driver initialization completed successfully.
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Initiating service 3 cleanup
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Service 3 cleanup completed.
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.service [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Creating RPC server for service cinder-volume {{(pid=85317) start /opt/stack/cinder/cinder/service.py:231}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.service [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85317) start /opt/stack/cinder/cinder/service.py:237}}
Sep 20 16:47:18 devstack cinder-volume[85317]: INFO cinder.volume.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG cinder.volume.drivers.quobyte [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:18 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:18 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:18 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:19 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:19 devstack cinder-volume[85317]: DEBUG oslo_concurrency.processutils [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.322s {{(pid=85317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:19 devstack cinder-volume[85317]: INFO cinder.volume.manager [None req-1edc20cc-130e-4f5a-88f3-ea3961a305c4 None None] Driver post RPC initialization completed successfully.
Sep 20 16:47:23 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Caught SIGTERM, stopping children
Sep 20 16:47:23 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Acquiring lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:23 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Acquired lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:23 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Releasing lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:23 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Stop services. {{(pid=85118) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 20 16:47:23 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Killing children. {{(pid=85118) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 20 16:47:23 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Waiting on 1 children to exit
Sep 20 16:47:25 devstack cinder-volume[85317]: DEBUG oslo_service.periodic_task [None req-14688d5d-232d-4af5-bdfb-4b6419a97298 None None] Running periodic task VolumeManager._thread_info {{(pid=85317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:47:25 devstack cinder-volume[85317]: DEBUG cinder.volume.manager [None req-14688d5d-232d-4af5-bdfb-4b6419a97298 None None] thread count: 6 {{(pid=85317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:47:25 devstack cinder-volume[85317]: DEBUG cinder.volume.manager [None req-14688d5d-232d-4af5-bdfb-4b6419a97298 None None] thread info: [<_MainThread(MainThread, started 134813594583168)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134813482379712)>, <Thread(Thread-3 (stat_writer), started daemon 134813479162752)>, <Thread(Rabbit-heartbeat, started daemon 134813477979520)>, <Thread(Thread-5 (_runner), started daemon 134813478113728)>, <Thread(Thread-7 (_runner), started daemon 134813478179712)>] {{(pid=85317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:47:27 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Acquiring lock "singleton_lock" {{(pid=85317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:27 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Acquired lock "singleton_lock" {{(pid=85317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:27 devstack cinder-volume[85317]: DEBUG oslo_concurrency.lockutils [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Releasing lock "singleton_lock" {{(pid=85317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:27 devstack cinder-volume[85317]: WARNING amqp [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 20 16:47:27 devstack cinder-volume[85317]: WARNING amqp [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 20 16:47:27 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-a72d4e95-57b6-4cbb-a0e8-142838dd4a01 None None] Child 85317 exited with status 0
Sep 20 16:47:27 devstack cinder-volume[85644]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 20 16:47:27 devstack cinder-volume[85644]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 20 16:47:27 devstack cinder-volume[85644]: we strongly recommend against using it for new projects.
Sep 20 16:47:27 devstack cinder-volume[85644]: If you are already using Eventlet, we recommend migrating to a different
Sep 20 16:47:27 devstack cinder-volume[85644]: framework.  For more detail see
Sep 20 16:47:27 devstack cinder-volume[85644]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 20 16:47:27 devstack cinder-volume[85644]:   import eventlet  # noqa
Sep 20 16:47:30 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 20 16:47:30 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 20 16:47:30 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO dbcounter [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Registered counter for database cinder
Sep 20 16:47:31 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:31 devstack cinder-volume[85644]: DEBUG dbcounter [-] [85644] Writer thread running {{(pid=85644) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO cinder.rpc [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO cinder.rpc [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 20 16:47:31 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO cinder.volume.manager [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Determined volume DB was empty at startup.
Sep 20 16:47:31 devstack cinder-volume[85644]: DEBUG cinder.volume.manager [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85644) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 20 16:47:31 devstack cinder-volume[85644]: WARNING stevedore.named [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 20 16:47:31 devstack cinder-volume[85644]: WARNING castellan.key_manager [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:47:31 devstack cinder-volume[85644]: WARNING cinder.keymgr.conf_key_mgr [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO cinder.volume.manager [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 20 16:47:31 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:31 devstack cinder-volume[85644]: INFO oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Starting 1 workers
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Started child 85945 {{(pid=85644) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Full set of CONF: {{(pid=85644) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] ******************************************************************************** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] Configuration options gathered from: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] ================================================================================ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] allow_availability_zone_fallback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] allow_compression_on_image_upload = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] allowed_direct_url_schemes     = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] api_rate_limit                 = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] auth_strategy                  = keystone {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_availability_zone      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_host                   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_name                   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_stats_polling_interval = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backup_api_class               = cinder.backup.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backup_name_template           = backup-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backup_use_same_host           = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backup_use_temp_snapshot       = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] chap_password                  = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] chap_username                  =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_internal_tenant_project_id = 4902a7df80a24fcab6458e91a226a717 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_internal_tenant_user_id = c2773a675fee477d9f9ca1c7ad6cdf34 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cluster                        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] compression_format             = gzip {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] compute_api_class              = cinder.compute.nova.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] config_dir                     = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] config_source                  = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] control_exchange               = openstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] debug                          = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] default_availability_zone      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] default_group_type             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] default_volume_type            = QuobyteHD {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] disk_geometry                  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_client_cert             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_client_cert_key         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_data_namespace          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_ssl_cert_path           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_ssl_cert_verify         = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] driver_use_ssl                 = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] enable_new_services            = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] enable_unsupported_driver      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] enabled_backends               = ['QuobyteHD'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] enforce_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] filter_function                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_api_insecure            = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_api_servers             = ['http://192.168.122.139/image'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_api_ssl_compression     = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_ca_certificates_file    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_catalog_info            = image:glance:publicURL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_certfile                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_keyfile                 = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_num_retries             = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance_request_timeout         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] goodness_function              = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] graceful_shutdown_timeout      = 5 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] group_api_class                = cinder.group.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] host                           = devstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_compress_on_upload       = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_conversion_address_space_limit = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_conversion_cpu_limit     = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_conversion_disable       = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_upload_use_cinder_backend = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_upload_use_internal_tenant = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_volume_cache_enabled     = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_volume_cache_max_count   = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] image_volume_cache_max_size_gb = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] init_host_max_objects_retrieval = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] instance_format                = [instance: %(uuid)s]  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iscsi_target_flags             =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iscsi_write_cache              = on {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iser_helper                    = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iser_ip_address                = 192.168.122.139 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iser_port                      = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_color                      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_config_append              = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_dir                        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_file                       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_options                    = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_rotate_interval            = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_rotate_interval_type       = days {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] log_rotation_type              = none {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] max_age                        = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] max_logfile_count              = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] max_logfile_size_mb            = 200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] max_over_subscription_ratio    = 20.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] message_reap_interval          = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] message_ttl                    = 2592000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] migration_create_volume_timeout_secs = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] monkey_patch                   = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] monkey_patch_modules           = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] my_ip                          = 192.168.122.139 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] no_snapshot_gb_quota           = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] num_iser_scan_tries            = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] num_shell_tries                = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] num_volume_device_scan_tries   = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] nvmeof_conn_info_version       = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] nvmet_ns_id                    = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] nvmet_port_id                  = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_max_limit                = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_ext_list          = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_listen_port       = 8776 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_use_ssl           = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] osapi_volume_workers           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] per_volume_size_limit          = -1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] periodic_fuzzy_delay           = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] periodic_interval              = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] public_endpoint                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] publish_errors                 = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_backup_gigabytes         = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_backups                  = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_gigabytes                = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_groups                   = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_snapshots                = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] quota_volumes                  = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] rate_limit_burst               = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] rate_limit_except_level        = CRITICAL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Starting volume driver QuobyteDriver (1.1.14)
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] rate_limit_interval            = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85945) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] reinit_driver_count            = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] replication_device             = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] report_discard_supported       = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] report_interval                = 120 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] reservation_clean_interval     = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] reservation_expire             = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] reserved_image_namespaces      = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] reserved_percentage            = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] rpc_response_timeout           = 120 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] run_external_periodic_tasks    = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] scst_target_driver             = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] scst_target_iqn_name           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_down_time              = 720 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] shell_completion               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] snapshot_name_template         = snapshot-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] split_loggers                  = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] state_path                     = /opt/stack/data/cinder {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] storage_availability_zone      = nova {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] storage_protocol               = iSCSI {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] syslog_log_facility            = LOG_USER {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_helper                  = lioadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_ip_address              = 192.168.122.139 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_port                    = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_protocol                = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] target_secondary_ip_addresses  = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] trace_flags                    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] transport_url                  = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] until_refresh                  = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_chap_auth                  = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_default_quota_class        = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_journal                    = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_json                       = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_multipath_for_image_xfer   = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_stderr                     = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] use_syslog                     = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] verify_glance_signatures       = enabled {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_api_class               = cinder.volume.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_backend_name            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_clear                   = zero {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_clear_ionice            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_clear_size              = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_copy_bps_limit          = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_dd_blocksize            = 1M {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_name_template           = volume-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_service_inithost_offload = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volume_usage_audit_period      = month {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] zoning_mode                    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_concurrency.disable_process_locking = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.auth_type   = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.auth_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.cache       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.certfile    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.delay_auth_decision = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.http_connect_timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.include_service_catalog = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.insecure    = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.interface   = public {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.keyfile     = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcache_username = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.region_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.service_token_roles_required = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.service_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.token_cache_time = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.backend                  = dogpile.cache.null {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.backend_argument         = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.backend_expiration_time  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.config_prefix            = cache.oslo {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.debug_cache_backend      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.enable_retry_client      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.enable_socket_keepalive  = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.enabled                  = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.expiration_time          = 600 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.hashclient_retry_attempts = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_dead_retry      = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_pool_maxsize    = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_sasl_enabled    = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.password                 = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.proxies                  = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.redis_db                 = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.redis_sentinel_service_name = mymaster {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.redis_server             = localhost:6379 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.retry_attempts           = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.retry_delay              = 0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.socket_keepalive_count   = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.socket_keepalive_idle    = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.socket_keepalive_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.socket_timeout           = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.tls_allowed_ciphers      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.tls_cafile               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.tls_certfile             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.tls_enabled              = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.tls_keyfile              = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cache.username                 = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] coordination.backend_url       = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.asyncio_connection    = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.asyncio_slave_connection = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.backend               = sqlalchemy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.connection            = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.connection_debug      = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.connection_parameters =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.connection_recycle_time = 3600 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.connection_trace      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.db_inc_retry_interval = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.db_max_retries        = 20 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.db_max_retry_interval = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.db_retry_interval     = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.max_overflow          = 50 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.max_pool_size         = 5 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.max_retries           = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.mysql_wsrep_sync_wait = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.pool_timeout          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.retry_interval        = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.slave_connection      = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.sqlite_synchronous    = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.synchronous_reader    = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] database.use_db_reconnect      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_tracing.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.connection_string     = messaging:// {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.enabled               = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.es_doc_type           = notification {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.es_scroll_size        = 10000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85945) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.es_scroll_time        = 2m {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 20 16:47:32 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.filter_error_trace    = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.hmac_keys             = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.sentinel_service_name = mymaster {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.socket_timeout        = 0.1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.trace_requests        = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Running cmd (subprocess): mount.quobyte {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler.trace_sqlalchemy      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler_jaeger.process_tags   = {} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler_jaeger.service_name_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] profiler_otlp.service_name_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.enforce_new_defaults = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.policy_default_rule = default {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.policy_file        = policy.yaml {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.group          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.helper_command = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] privsep_osbrick.user           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.group         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.helper_command = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] cinder_sys_admin.user          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.auth_section      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.auth_type         = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.cafile            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.certfile          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.collect_timing    = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.insecure          = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.keyfile           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.send_service_user_token = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.split_loggers     = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.timeout           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.tls_ciphers       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] service_user.tls_min_version   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.auth_section            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.auth_type               = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.certfile                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.collect_timing          = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.insecure                = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.keyfile                 = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.region_name             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.split_loggers           = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.timeout                 = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.tls_ciphers             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] glance.tls_min_version         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.backend_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.chap_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.chap_username =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.disk_geometry = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_client_cert = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_client_cert_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_data_namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.driver_use_ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.enable_unsupported_driver = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.extra_capabilities = {} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.filter_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.goodness_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iscsi_target_flags =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iscsi_write_cache = on {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iser_helper   = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iser_port     = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_host      =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_login     = admin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_mount_options = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_password  = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_private_key =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_share_path =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.num_shell_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.nvmet_port_id = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_client_cfg = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.quobyte_volume_url = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.replication_device = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.report_discard_supported = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.reserved_percentage = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.scst_target_driver = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.scst_target_iqn_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.storage_protocol = iSCSI {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_helper = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack quobyte-client[85946]: Reading configuration file: /etc/quobyte/client.cfg
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_port   = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_protocol = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.trace_flags   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.unique_fqdn_network = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack quobyte-client[85946]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.use_chap_auth = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_backend_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_clear  = zero {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_clear_ionice = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_clear_size = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_reports.file_event_handler = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_reports.log_dir           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.backend_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.backend_host         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.chap_password        = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.chap_username        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.chiscsi_conf         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.disk_geometry        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_client_cert   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_client_cert_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_data_namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.driver_use_ssl       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.extra_capabilities   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.filter_function      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.goodness_function    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iser_helper          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iser_ip_address      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iser_port            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.iser_target_prefix   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_host             = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_login            = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_mount_options    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_password         = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_private_key      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_share_path       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_ssh_port         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.num_shell_tries      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.nvmet_port_id        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.replication_device   = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.report_discard_supported = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.reserved_percentage  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.scst_target_driver   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.storage_protocol     = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_helper        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_ip_address    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_port          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_prefix        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_protocol      = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.trace_flags          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.use_chap_auth        = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack sudo[85954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_clear         = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_clear_size    = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] QuobyteHD.volumes_dir          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl      = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_notifications.driver = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_notifications.retry = -1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] oslo_messaging_notifications.transport_url = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] key_manager.fixed_key          = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.barbican_api_version  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.barbican_endpoint     = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.barbican_endpoint_type = public {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.barbican_region_name  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.cafile                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.certfile              = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.collect_timing        = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.insecure              = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.keyfile               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.number_of_retries     = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.retry_delay           = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.send_service_user_token = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.split_loggers         = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.timeout               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.tls_ciphers           = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.tls_min_version       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.verify_ssl            = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican.verify_ssl_path       = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.auth_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.cafile   = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.collect_timing = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.keyfile  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.timeout  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.tls_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] barbican_service_user.tls_min_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.approle_role_id          = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.approle_secret_id        = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.auth_method              = approle {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.auth_path                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.kv_mountpoint            = secret {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.kv_path                  = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.kv_version               = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.namespace                = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.root_token_id            = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.ssl_ca_crt_file          = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.timeout                  = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.token_file               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.token_role               = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.use_ssl                  = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 20 16:47:32 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a473789c-1105-4baa-b94e-2f80a238c06b None None] ******************************************************************************** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 20 16:47:32 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.246s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.volume.driver [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Driver hasn't implemented _init_vendor_properties()
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.driver [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.677089691162, 'free_capacity_gb': 1775.677089691162, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85945) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_db.sqlalchemy.engines [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writer thread running {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.db.api [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Building query based on filter {{(pid=85945) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3953}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85945) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.keymgr.migration [None req-889733b1-65f2-4567-87a8-b18823eb9740 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 20 16:47:32 devstack sudo[85968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:32 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:32 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Driver initialization completed successfully.
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Initiating service 3 cleanup
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Service 3 cleanup completed.
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.service [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Creating RPC server for service cinder-volume {{(pid=85945) start /opt/stack/cinder/cinder/service.py:231}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.service [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85945) start /opt/stack/cinder/cinder/service.py:237}}
Sep 20 16:47:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:47:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:47:32 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:47:32 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:47:33 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Sep 20 16:47:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.235s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:47:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-672b0a57-12ad-455a-b622-9711ee1009fe None None] Driver post RPC initialization completed successfully.
Sep 20 16:47:41 devstack cinder-volume[85644]: DEBUG dbcounter [-] [85644] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85644) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:47:42 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:47:43 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:47:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:47:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 6 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:47:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:48:30 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:48:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Flow 'volume_create_manager' (5e85bf0c-6b61-47dd-afba-cb44890426ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:48:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8ed0b-c617-405c-aaac-e9d1afea4c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8ed0b-c617-405c-aaac-e9d1afea4c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1990561467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc743c5-08df-4d68-a676-4818c06973ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed9dbdf8b7049a2bf7291527893eb3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:48:31Z,use_quota=True,user_id='0f011cfc82504a4bb7ded6f57f4b5cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3689f43e-c264-4b0a-8543-3875bed3f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3689f43e-c264-4b0a-8543-3875bed3f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac28ae1-83ab-4de4-ba54-074a940c7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac28ae1-83ab-4de4-ba54-074a940c7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc743c5-08df-4d68-a676-4818c06973ca', 'volume_name': 'volume-dfc743c5-08df-4d68-a676-4818c06973ca', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504ae00-7a0b-4e90-b77b-2ef53945d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504ae00-7a0b-4e90-b77b-2ef53945d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3aa7b0-b6cc-4775-8ead-7995a57d546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Volume dfc743c5-08df-4d68-a676-4818c06973ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc743c5-08df-4d68-a676-4818c06973ca', 'volume_size': 1}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1990561467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc743c5-08df-4d68-a676-4818c06973ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed9dbdf8b7049a2bf7291527893eb3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:48:31Z,use_quota=True,user_id='0f011cfc82504a4bb7ded6f57f4b5cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Creating volume dfc743c5-08df-4d68-a676-4818c06973ca {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:48:31 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:48:31 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca 1073741824
Sep 20 16:48:31 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:48:31 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca 1073741824" returned: 0 in 0.674s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:48:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:48:31 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca
Sep 20 16:48:31 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:48:32 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca" returned: 0 in 0.441s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3aa7b0-b6cc-4775-8ead-7995a57d546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc743c5-08df-4d68-a676-4818c06973ca', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0005458-5863-4155-b23e-c924d41a09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:48:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Volume volume-dfc743c5-08df-4d68-a676-4818c06973ca (dfc743c5-08df-4d68-a676-4818c06973ca): created successfully
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0005458-5863-4155-b23e-c924d41a09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:48:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Flow 'volume_create_manager' (5e85bf0c-6b61-47dd-afba-cb44890426ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:48:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-370b6ed7-fc70-4f30-82b5-29af0b127fb2 tempest-TaggedAttachmentsTest-1172191315 None] Created volume successfully.
Sep 20 16:48:42 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:48:42 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:48:58 devstack sudo[87032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:48:58 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:48:58 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.569s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 6 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:48:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Flow 'volume_create_manager' (9ccdd3b5-3ea6-4172-825e-9cea3971f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afea9a1-f983-4f71-93fc-db32e710c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afea9a1-f983-4f71-93fc-db32e710c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1536129507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed4068c-ba5a-4f36-b599-541bd89d87a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a43af4f039e4071845d43d8a84cbdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:07Z,use_quota=True,user_id='2e0f769bd43543b2bb99e294b4ab8028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0ed95-d478-4753-8232-a6c9092986c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0ed95-d478-4753-8232-a6c9092986c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a37e32-b739-41bb-8fa0-55bd7cdf7fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a37e32-b739-41bb-8fa0-55bd7cdf7fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed4068c-ba5a-4f36-b599-541bd89d87a8', 'volume_name': 'volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1926bb37-0350-4faa-b324-604ab9ff2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1926bb37-0350-4faa-b324-604ab9ff2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055adaa4-a6dd-46df-8f42-ca7b9a33a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:07 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Volume 6ed4068c-ba5a-4f36-b599-541bd89d87a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8', 'volume_size': 1}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1536129507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed4068c-ba5a-4f36-b599-541bd89d87a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a43af4f039e4071845d43d8a84cbdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:07Z,use_quota=True,user_id='2e0f769bd43543b2bb99e294b4ab8028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Creating volume 6ed4068c-ba5a-4f36-b599-541bd89d87a8 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:49:07 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:49:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:07 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 1073741824
Sep 20 16:49:07 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:08 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 1073741824" returned: 0 in 1.104s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:09 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8
Sep 20 16:49:09 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:09 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8" returned: 0 in 0.623s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055adaa4-a6dd-46df-8f42-ca7b9a33a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9412781a-2d63-44c8-a6aa-a838c62c5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Volume volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 (6ed4068c-ba5a-4f36-b599-541bd89d87a8): created successfully
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9412781a-2d63-44c8-a6aa-a838c62c5460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Flow 'volume_create_manager' (9ccdd3b5-3ea6-4172-825e-9cea3971f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bc2231e4-b583-46c3-98d5-6855b6740a22 tempest-VolumesAdminNegativeTest-188957485 None] Created volume successfully.
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Flow 'volume_create_manager' (9b6b31f2-0c89-49d4-a2ad-d71a158ed1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a687a29-1f44-4fed-9d3c-e110aef50e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a687a29-1f44-4fed-9d3c-e110aef50e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-167393134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a0130-3736-4935-92cc-5a6d1b1c82d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9a88dd12a7424d99f87cee248706d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:11Z,use_quota=True,user_id='a2556b0948b044088637ead57f6c1439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dccd6d6-ec7a-4ed0-a4a6-d0e3a7160886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dccd6d6-ec7a-4ed0-a4a6-d0e3a7160886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff9d3bb-e9cf-42fe-880e-ab9be34cbc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff9d3bb-e9cf-42fe-880e-ab9be34cbc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57a0130-3736-4935-92cc-5a6d1b1c82d1', 'volume_name': 'volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006bf885-74bc-4143-a4f8-8edf188f9332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006bf885-74bc-4143-a4f8-8edf188f9332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d2a7d-d22b-46c7-8c30-08e6d9c90010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Volume c57a0130-3736-4935-92cc-5a6d1b1c82d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1', 'volume_size': 1}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-167393134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a0130-3736-4935-92cc-5a6d1b1c82d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9a88dd12a7424d99f87cee248706d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:11Z,use_quota=True,user_id='a2556b0948b044088637ead57f6c1439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Creating volume c57a0130-3736-4935-92cc-5a6d1b1c82d1 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:49:11 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:49:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:11 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 1073741824
Sep 20 16:49:11 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Acquiring lock "cinder-6ed4068c-ba5a-4f36-b599-541bd89d87a8-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "cinder-6ed4068c-ba5a-4f36-b599-541bd89d87a8-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:12 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 1073741824" returned: 0 in 0.993s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Acquiring lock "cinder-quobyte-6ed4068c-ba5a-4f36-b599-541bd89d87a8" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "cinder-quobyte-6ed4068c-ba5a-4f36-b599-541bd89d87a8" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:12 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy9f4c8dw/privsep.sock']
Sep 20 16:49:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:12 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy9f4c8dw/privsep.sock
Sep 20 16:49:12 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:12 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1
Sep 20 16:49:12 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:13 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1" returned: 0 in 0.468s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d2a7d-d22b-46c7-8c30-08e6d9c90010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d399bfe-efea-44fe-8c80-96540aaec2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Volume volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 (c57a0130-3736-4935-92cc-5a6d1b1c82d1): created successfully
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d399bfe-efea-44fe-8c80-96540aaec2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Flow 'volume_create_manager' (9b6b31f2-0c89-49d4-a2ad-d71a158ed1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9f6fb30c-77e4-430e-9324-b0970a2a8fbd tempest-ServerRescueNegativeTestJSON-1102147476 None] Created volume successfully.
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 20 16:49:14 devstack cinder-volume[85945]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 20 16:49:15 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:15 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Spawned new privsep daemon via rootwrap
Sep 20 16:49:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Accepted privsep connection to /tmp/tmpy9f4c8dw/privsep.sock {{(pid=85945) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 20 16:49:15 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 20 16:49:15 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 20 16:49:15 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 20 16:49:15 devstack cinder-volume[85945]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87279
Sep 20 16:49:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ff2b5-77c1-44ad-bac6-c7ae4d78d622]: (2,) {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc9802-364d-4ddc-9a9e-9619e9c36456]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:15 devstack sudo[87282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8
Sep 20 16:49:15 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:16 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8" returned: 0 in 0.701s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:16 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8
Sep 20 16:49:16 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:16 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed4068c-ba5a-4f36-b599-541bd89d87a8" returned: 0 in 0.742s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "cinder-quobyte-6ed4068c-ba5a-4f36-b599-541bd89d87a8" released by "delete_volume" :: held 4.353s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:17 devstack cinder-volume[85945]: WARNING cinder.quota [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:49:17 devstack cinder-volume[85945]: WARNING cinder.quota [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Created reservations ['520ac322-f747-4f55-95bc-ce5eb093f5cd', 'b8c519e4-0a4c-47f3-b79e-f6ba73e0de72', 'cb790049-bffc-48e1-86d6-d73fb151a0d8', '0fd4f830-6246-4644-8387-fb062eacfb89'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:17 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:49:17 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:18 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.521s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:18 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:49:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Deleted volume successfully.
Sep 20 16:49:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c29e6d10-033f-4532-b54c-cc5eea13f16c tempest-VolumesAdminNegativeTest-188957485 None] Lock "cinder-6ed4068c-ba5a-4f36-b599-541bd89d87a8-delete_volume" released by "delete_volume" :: held 5.715s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Flow 'volume_create_manager' (4ecf2c1a-c651-44f7-99e7-33b62206061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dbd37c-4e89-415e-82b3-2edbdc2ecef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dbd37c-4e89-415e-82b3-2edbdc2ecef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1158998057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959121c2-0e7a-4a51-8c32-42a875f83cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5379034779fb41248c7b4dad8b3e1032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:24Z,use_quota=True,user_id='aea7d8699630407f8252119ca72cd04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4358dee1-42e5-4556-a7d7-56765d4b78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4358dee1-42e5-4556-a7d7-56765d4b78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3efa8b0-e73a-421d-8e94-7ddb1e6a2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3efa8b0-e73a-421d-8e94-7ddb1e6a2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959121c2-0e7a-4a51-8c32-42a875f83cff', 'volume_name': 'volume-959121c2-0e7a-4a51-8c32-42a875f83cff', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c409b69d-96ff-4c85-a321-01c4a3d2e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c409b69d-96ff-4c85-a321-01c4a3d2e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318246f9-9022-4b94-b13f-49481913d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Volume 959121c2-0e7a-4a51-8c32-42a875f83cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959121c2-0e7a-4a51-8c32-42a875f83cff', 'volume_size': 1}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1158998057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959121c2-0e7a-4a51-8c32-42a875f83cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5379034779fb41248c7b4dad8b3e1032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:49:24Z,use_quota=True,user_id='aea7d8699630407f8252119ca72cd04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Creating volume 959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:49:24 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:49:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:24 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff 1073741824
Sep 20 16:49:24 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:25 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff 1073741824" returned: 0 in 1.025s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:25 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff
Sep 20 16:49:25 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:25 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318246f9-9022-4b94-b13f-49481913d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959121c2-0e7a-4a51-8c32-42a875f83cff', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a0c7a4-e136-4537-8b00-40df6d820421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:49:25 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Volume volume-959121c2-0e7a-4a51-8c32-42a875f83cff (959121c2-0e7a-4a51-8c32-42a875f83cff): created successfully
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a0c7a4-e136-4537-8b00-40df6d820421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:49:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Flow 'volume_create_manager' (4ecf2c1a-c651-44f7-99e7-33b62206061c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:49:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-abfc75a4-efec-4be3-85f5-e092375a19d0 req-be048436-506e-4c0f-a929-980087f8f656 tempest-VolumesSnapshotsTestJSON-1448567119 None] Created volume successfully.
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Creating offline snapshot 432057c5-252f-4cf4-8319-9f99fe0213df of volume 959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9497000d-078d-4b98-a3cf-736b927ad998]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:27 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff
Sep 20 16:49:27 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:27 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff" returned: 0 in 0.668s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:27 devstack sudo[87427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df 1G
Sep 20 16:49:27 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:28 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df 1G" returned: 0 in 0.585s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959121c2-0e7a-4a51-8c32-42a875f83cff -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:28 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959121c2-0e7a-4a51-8c32-42a875f83cff -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df
Sep 20 16:49:28 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:29 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959121c2-0e7a-4a51-8c32-42a875f83cff -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df" returned: 0 in 0.732s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:29 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df is being set with open permissions: ugo+rw
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:29 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df
Sep 20 16:49:29 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:29 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df" returned: 0 in 0.282s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:29 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info
Sep 20 16:49:29 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:29 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:29 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info is being set with open permissions: ugo+rw
Sep 20 16:49:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:29 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info
Sep 20 16:49:29 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:30 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.info" returned: 0 in 0.603s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-0c375265-47af-463b-a855-4f9db8ec9ac5 req-532ed4b1-daee-4487-ada6-77772462515c tempest-VolumesSnapshotsTestJSON-1448567119 None] Create snapshot completed successfully
Sep 20 16:49:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Acquiring lock "cinder-c57a0130-3736-4935-92cc-5a6d1b1c82d1-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "cinder-c57a0130-3736-4935-92cc-5a6d1b1c82d1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Acquiring lock "cinder-quobyte-c57a0130-3736-4935-92cc-5a6d1b1c82d1" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "cinder-quobyte-c57a0130-3736-4935-92cc-5a6d1b1c82d1" acquired by "delete_volume" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a315392-4fa4-4197-9902-df0b1a70d9e5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "cinder-432057c5-252f-4cf4-8319-9f99fe0213df-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-432057c5-252f-4cf4-8319-9f99fe0213df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "cinder-quobyte-432057c5-252f-4cf4-8319-9f99fe0213df" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-432057c5-252f-4cf4-8319-9f99fe0213df" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Deleting offline snapshot 432057c5-252f-4cf4-8319-9f99fe0213df of volume 959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] snapshot_file for this snap is: volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[79671b68-2483-4176-92fa-d8d9e3bbd96d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:31 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1
Sep 20 16:49:31 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:31 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df
Sep 20 16:49:31 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:31 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1" returned: 0 in 0.738s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:32 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1
Sep 20 16:49:32 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:32 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df" returned: 0 in 0.745s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959121c2-0e7a-4a51-8c32-42a875f83cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a45d7-7687-45b4-9380-00868280b5c5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:32 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c57a0130-3736-4935-92cc-5a6d1b1c82d1" returned: 0 in 0.403s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "cinder-quobyte-c57a0130-3736-4935-92cc-5a6d1b1c82d1" released by "delete_volume" :: held 1.227s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Created reservations ['823d33f5-1867-4ca4-b78f-1ecbe5118ddc', 'f0f56b87-5544-4776-989a-2a664722957b', '4432022b-8ef7-4fe1-a540-f3c778cc279a', 'bf840c20-296e-488d-a976-e57dd6292e70'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:49:32 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff
Sep 20 16:49:32 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:32 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:49:32 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:32 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff" returned: 0 in 0.457s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:32 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df
Sep 20 16:49:32 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:32 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:49:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Deleted volume successfully.
Sep 20 16:49:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4931d9b7-f6a8-4a24-a8db-c07667627fdf tempest-ServerRescueNegativeTestJSON-1102147476 None] Lock "cinder-c57a0130-3736-4935-92cc-5a6d1b1c82d1-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:33 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df" returned: 0 in 0.483s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:33 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df
Sep 20 16:49:33 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:33 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff.432057c5-252f-4cf4-8319-9f99fe0213df" returned: 0 in 0.430s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-432057c5-252f-4cf4-8319-9f99fe0213df" released by "_delete_snapshot" :: held 2.298s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" released by "delete_snapshot" :: held 2.390s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:33 devstack cinder-volume[85945]: WARNING cinder.quota [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:49:33 devstack cinder-volume[85945]: DEBUG cinder.quota [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Created reservations ['b95f352b-d267-446c-b76a-c5053ae4e48d', '47bfc570-79bc-41e5-8baa-9cb8f3d0a76f', '0e30d4ea-b7a0-4473-96a3-5b1b61468f94', '2e3365c1-c5f2-4df7-b2c9-597b30747078'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:49:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Delete snapshot completed successfully.
Sep 20 16:49:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-9ed75344-6f18-4a28-9649-fc08ff149bf9 req-1b168ebf-bc85-40f2-8890-ce147c4cc330 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-432057c5-252f-4cf4-8319-9f99fe0213df-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "cinder-959121c2-0e7a-4a51-8c32-42a875f83cff-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-959121c2-0e7a-4a51-8c32-42a875f83cff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" acquired by "delete_volume" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203581f-12dd-419e-af57-222d5693d028]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:35 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff
Sep 20 16:49:35 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:35 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff" returned: 0 in 0.507s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:35 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff
Sep 20 16:49:35 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:36 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-959121c2-0e7a-4a51-8c32-42a875f83cff" returned: 0 in 0.426s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-quobyte-959121c2-0e7a-4a51-8c32-42a875f83cff" released by "delete_volume" :: held 1.052s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.quota [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Created reservations ['b14ad929-eed2-4f3e-9442-418dd10d0b81', '783cc512-e120-4228-b498-eb6b895e6bf5', 'b388ea73-0223-46de-9b96-fbda751eb351', '02b5b595-0dcc-4962-a9f9-371bb1c55314'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:36 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:49:36 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:36 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.299s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.manager [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:49:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Deleted volume successfully.
Sep 20 16:49:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-50036fba-8623-4804-92b0-96d98f45fe56 req-35fc2236-2ca4-45bd-a071-961ea770e419 tempest-VolumesSnapshotsTestJSON-1448567119 None] Lock "cinder-959121c2-0e7a-4a51-8c32-42a875f83cff-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:49:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29198e27-699d-4f7c-8159-5d208e887ed3 tempest-BackendsCapabilitiesAdminTestsJSON-749948287 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.677089691162, 'free_capacity_gb': 1775.677089691162, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85945) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 20 16:49:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6b67f89-9c95-474e-98b4-ede7ae58164c tempest-BackendsCapabilitiesAdminTestsJSON-749948287 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.677089691162, 'free_capacity_gb': 1775.677089691162, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85945) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 20 16:49:46 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=30,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=4 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:49:46 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=31,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=9 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:49:58 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:49:58 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:49:58 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.380s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:49:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Flow 'volume_create_manager' (7f13f4e4-abbd-4161-bbbc-7fb19f6231dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41854133-a900-4726-be1a-2d2205417281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41854133-a900-4726-be1a-2d2205417281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-256078556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cefe3e-7bd1-45c2-81c7-697bc433a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5e296bc8b34dcc8fece589bd9bb37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:07Z,use_quota=True,user_id='e1982bb43bd343358a0ac23375bb9dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed88259-0501-4acd-b9f1-85818d2af49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed88259-0501-4acd-b9f1-85818d2af49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2506740d-90fb-410d-96df-3526d1b60544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2506740d-90fb-410d-96df-3526d1b60544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cefe3e-7bd1-45c2-81c7-697bc433a752', 'volume_name': 'volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e6b657-f26d-4edc-9501-2fd9c53ac567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e6b657-f26d-4edc-9501-2fd9c53ac567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2140fda-ead3-4729-92be-6850be7fc013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:07 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Volume c9cefe3e-7bd1-45c2-81c7-697bc433a752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752', 'volume_size': 1}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-256078556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cefe3e-7bd1-45c2-81c7-697bc433a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5e296bc8b34dcc8fece589bd9bb37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:07Z,use_quota=True,user_id='e1982bb43bd343358a0ac23375bb9dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Creating volume c9cefe3e-7bd1-45c2-81c7-697bc433a752 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:50:07 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:50:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:07 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 1073741824
Sep 20 16:50:07 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:08 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 1073741824" returned: 0 in 0.907s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:08 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752
Sep 20 16:50:08 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:08 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2140fda-ead3-4729-92be-6850be7fc013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99feaf94-b308-4e82-b436-cdad8dc26c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Volume volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 (c9cefe3e-7bd1-45c2-81c7-697bc433a752): created successfully
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99feaf94-b308-4e82-b436-cdad8dc26c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Flow 'volume_create_manager' (7f13f4e4-abbd-4161-bbbc-7fb19f6231dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fc581bf4-db13-44de-934a-974c4f6a25d3 tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Created volume successfully.
Sep 20 16:50:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Acquiring lock "cinder-c9cefe3e-7bd1-45c2-81c7-697bc433a752-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "cinder-c9cefe3e-7bd1-45c2-81c7-697bc433a752-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Acquiring lock "cinder-quobyte-c9cefe3e-7bd1-45c2-81c7-697bc433a752" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "cinder-quobyte-c9cefe3e-7bd1-45c2-81c7-697bc433a752" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[386aa882-4f4a-4911-8f93-d65fb32fdb74]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:11 devstack cinder-volume[85945]: WARNING py.warnings [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] /opt/stack/cinder/cinder/db/api.py:2479: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 20 16:50:11 devstack cinder-volume[85945]:   .first()
Sep 20 16:50:11 devstack cinder-volume[85945]: 
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d3657-2c42-42d9-a246-48ffea6edb87]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:11 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752
Sep 20 16:50:11 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:11 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca
Sep 20 16:50:11 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:11 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752" returned: 0 in 0.730s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:11 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752
Sep 20 16:50:11 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:12 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca" returned: 0 in 0.890s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-dfc743c5-08df-4d68-a676-4818c06973ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b59fe207-408e-4393-8e0b-7fbfcaa5648b', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:50:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-c09eae64-2d60-4ea8-abe9-80b47a8a6b24 req-cf69978e-780b-4231-b9a8-d75ca98218ed tempest-TaggedAttachmentsTest-1172191315 None] attachment_update completed successfully.
Sep 20 16:50:12 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9cefe3e-7bd1-45c2-81c7-697bc433a752" returned: 0 in 0.593s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "cinder-quobyte-c9cefe3e-7bd1-45c2-81c7-697bc433a752" released by "delete_volume" :: held 1.482s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Created reservations ['73a7c5c3-7ad4-4933-bd88-9d643bce791f', 'd5daca53-7875-46da-89d0-e3f1849905a7', 'd0647f7e-0d65-4505-86da-36b7e8982711', 'a0636c3f-5f97-498d-9337-3153a90b9e14'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:12 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:50:12 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:13 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:13 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Deleted volume successfully.
Sep 20 16:50:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-382f9ad6-7b0a-4baf-86f8-4702d4267cba tempest-VolumeQuotasNegativeTestJSON-1322964645 None] Lock "cinder-c9cefe3e-7bd1-45c2-81c7-697bc433a752-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Flow 'volume_create_manager' (e5fb3bc0-70cf-4f2d-bf54-33e884499727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f6256-605d-4e45-a14c-6952bbb95e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f6256-605d-4e45-a14c-6952bbb95e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-227478343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c0a243-28c7-4ed5-8822-00b78509f40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6428a5e3c14a1ba50996b3400ebe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:18Z,use_quota=True,user_id='aa9a9b920001423fa4d9d1ce272f0a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f308e3b-16f1-4628-909b-e2e4bd2afb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f308e3b-16f1-4628-909b-e2e4bd2afb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94baf1fa-8171-411c-a006-3b5c2f2d723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94baf1fa-8171-411c-a006-3b5c2f2d723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c0a243-28c7-4ed5-8822-00b78509f40c', 'volume_name': 'volume-67c0a243-28c7-4ed5-8822-00b78509f40c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4092268a-4996-46f2-b492-8ca8554a2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4092268a-4996-46f2-b492-8ca8554a2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82391c36-3bdc-4c5f-b144-c860c26488e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Volume 67c0a243-28c7-4ed5-8822-00b78509f40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c0a243-28c7-4ed5-8822-00b78509f40c', 'volume_size': 1}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-227478343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c0a243-28c7-4ed5-8822-00b78509f40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6428a5e3c14a1ba50996b3400ebe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:18Z,use_quota=True,user_id='aa9a9b920001423fa4d9d1ce272f0a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Creating volume 67c0a243-28c7-4ed5-8822-00b78509f40c {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:50:18 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:18 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c 1073741824
Sep 20 16:50:18 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-ed4d8e44-3516-44d6-82cb-3e168441a661 req-b7f96f75-2d39-4122-b3bb-29e01c757357 tempest-TaggedAttachmentsTest-1172191315 None] Terminate volume connection completed successfully.
Sep 20 16:50:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-ed4d8e44-3516-44d6-82cb-3e168441a661 req-b7f96f75-2d39-4122-b3bb-29e01c757357 tempest-TaggedAttachmentsTest-1172191315 None] Deleting attachment b59fe207-408e-4393-8e0b-7fbfcaa5648b. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:50:19 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c 1073741824" returned: 0 in 1.191s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:19 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c
Sep 20 16:50:19 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:20 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c" returned: 0 in 0.997s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82391c36-3bdc-4c5f-b144-c860c26488e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c0a243-28c7-4ed5-8822-00b78509f40c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3e2533-a94c-4594-a46f-4a323e4e3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Volume volume-67c0a243-28c7-4ed5-8822-00b78509f40c (67c0a243-28c7-4ed5-8822-00b78509f40c): created successfully
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3e2533-a94c-4594-a46f-4a323e4e3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Flow 'volume_create_manager' (e5fb3bc0-70cf-4f2d-bf54-33e884499727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-402d3428-1b8b-4ea6-aca5-634b1aa1f9a1 tempest-DeleteServersTestJSON-1309517988 None] Created volume successfully.
Sep 20 16:50:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1625a7-3bad-4068-ae80-7ae7757a5e26]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:24 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c
Sep 20 16:50:24 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:25 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c" returned: 0 in 1.032s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.074s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-67c0a243-28c7-4ed5-8822-00b78509f40c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44d39746-dd5c-4293-9e36-d8fea3dc1058', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:50:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-3ed5402f-3496-4301-ba7a-9a94524146cc req-5e687d98-51cd-48a6-a88a-f11369833ebd tempest-DeleteServersTestJSON-1309517988 None] attachment_update completed successfully.
Sep 20 16:50:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-0d40d304-1b64-45ed-9325-473797de78d8 req-a288c733-6678-4890-87cd-5e3f715b5bb7 tempest-DeleteServersTestJSON-1309517988 None] Terminate volume connection completed successfully.
Sep 20 16:50:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-0d40d304-1b64-45ed-9325-473797de78d8 req-a288c733-6678-4890-87cd-5e3f715b5bb7 tempest-DeleteServersTestJSON-1309517988 None] Deleting attachment 44d39746-dd5c-4293-9e36-d8fea3dc1058. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "cinder-67c0a243-28c7-4ed5-8822-00b78509f40c-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "cinder-67c0a243-28c7-4ed5-8822-00b78509f40c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "cinder-quobyte-67c0a243-28c7-4ed5-8822-00b78509f40c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "cinder-quobyte-67c0a243-28c7-4ed5-8822-00b78509f40c" acquired by "delete_volume" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c7110-8cbc-4473-b7d8-fb8e3e760ba1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:32 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c
Sep 20 16:50:32 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "cinder-dfc743c5-08df-4d68-a676-4818c06973ca-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:33 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c" returned: 0 in 0.524s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "cinder-dfc743c5-08df-4d68-a676-4818c06973ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:33 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c
Sep 20 16:50:33 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "cinder-quobyte-dfc743c5-08df-4d68-a676-4818c06973ca" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "cinder-quobyte-dfc743c5-08df-4d68-a676-4818c06973ca" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f43b9-44d9-4c6a-9c46-6c6960591271]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:33 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca
Sep 20 16:50:33 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:33 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67c0a243-28c7-4ed5-8822-00b78509f40c" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "cinder-quobyte-67c0a243-28c7-4ed5-8822-00b78509f40c" released by "delete_volume" :: held 0.897s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Created reservations ['db3b0bca-c810-4f71-9401-c59db05c71f4', 'dcaa1385-10ed-467a-9362-ac668522d686', '8ae5ab0a-51f7-4685-9d31-5126edc49d04', 'cf43241b-f613-4e08-b368-471e60598ce5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:33 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:50:33 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:33 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:33 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca
Sep 20 16:50:33 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:34 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.301s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:34 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Deleted volume successfully.
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-dfc743c5-08df-4d68-a676-4818c06973ca" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "cinder-quobyte-dfc743c5-08df-4d68-a676-4818c06973ca" released by "delete_volume" :: held 0.756s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-83376641-520d-4e38-acfd-d65dff6bf125 tempest-DeleteServersTestJSON-1309517988 None] Lock "cinder-67c0a243-28c7-4ed5-8822-00b78509f40c-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Created reservations ['43b32481-cd86-4b36-aa40-0607af49b75c', '385148c8-eb91-4e00-823b-bbd943be5c02', '9d47fc5d-f431-4363-90ba-9d3d512c1cbc', '633fea56-b5a1-4b61-b748-521775b2328c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:34 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:50:34 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:34 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.319s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Deleted volume successfully.
Sep 20 16:50:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ea016a49-5d27-4616-aa10-3e4d63f2fdcc tempest-TaggedAttachmentsTest-1172191315 None] Lock "cinder-dfc743c5-08df-4d68-a676-4818c06973ca-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Flow 'volume_create_manager' (6347077b-15fd-4cc0-8a95-068dcc8bbae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffe987b-de05-4774-88e3-1c5f6d0328de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffe987b-de05-4774-88e3-1c5f6d0328de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-633952675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102e30d0-95a6-4a7d-81a2-d64c602d2363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e063e407046a79b98ea513a617b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:45Z,use_quota=True,user_id='15dafb5ea1a94249a62f632db904b306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3992e96-f143-4b5d-8f3f-5fb402e733bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3992e96-f143-4b5d-8f3f-5fb402e733bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a46231-218a-4bdc-ba16-df105076807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:44 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 16:50:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a46231-218a-4bdc-ba16-df105076807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '102e30d0-95a6-4a7d-81a2-d64c602d2363', 'volume_name': 'volume-102e30d0-95a6-4a7d-81a2-d64c602d2363', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fd4ff20>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e471bf-5c30-4692-80ad-87f53aed34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e471bf-5c30-4692-80ad-87f53aed34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0ff1e4-4df0-40b5-a1d2-cbee44a67b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Volume 102e30d0-95a6-4a7d-81a2-d64c602d2363: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-102e30d0-95a6-4a7d-81a2-d64c602d2363', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fd4ff20>}
Sep 20 16:50:45 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Trying to clone 102e30d0-95a6-4a7d-81a2-d64c602d2363 from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 16:50:46 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Image download 20.69 MB at 20.69 MB/s
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79132be-2aaf-497d-b680-3107df1524a6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:50:46 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD
Sep 20 16:50:46 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (df1a9b5e-3099-463c-a1d4-104f8544d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16b837c-4829-467c-a36a-109589700bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16b837c-4829-467c-a36a-109589700bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2057056551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e205a9-2155-4afa-baf1-7204bde1dd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:46Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50392c5-4f63-487c-a92f-dc3c0d2f9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50392c5-4f63-487c-a92f-dc3c0d2f9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9f650-7b2b-430e-a387-87fdcc0af6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9f650-7b2b-430e-a387-87fdcc0af6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e205a9-2155-4afa-baf1-7204bde1dd1b', 'volume_name': 'volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78eaf58d-2031-462b-a2d3-279c2fa2ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78eaf58d-2031-462b-a2d3-279c2fa2ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545c0e8-124e-49d4-b7a8-da5071bf001a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:46 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Volume c3e205a9-2155-4afa-baf1-7204bde1dd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b', 'volume_size': 1}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2057056551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e205a9-2155-4afa-baf1-7204bde1dd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:46Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Creating volume c3e205a9-2155-4afa-baf1-7204bde1dd1b {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:50:46 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:46 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b 1073741824
Sep 20 16:50:46 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:46 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 is fetched for user 15dafb5ea1a94249a62f632db904b306. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a64168-fa34-4555-8163-5c22c578d30f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:46 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD
Sep 20 16:50:46 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:47 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b 1073741824" returned: 0 in 0.579s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:47 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b
Sep 20 16:50:47 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:47 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:47 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b" returned: 0 in 0.376s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-633952675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102e30d0-95a6-4a7d-81a2-d64c602d2363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e063e407046a79b98ea513a617b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:50:45Z,use_quota=True,user_id='15dafb5ea1a94249a62f632db904b306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Creating volume 102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:50:47 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:47 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1073741824
Sep 20 16:50:47 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545c0e8-124e-49d4-b7a8-da5071bf001a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda0fbb0-8699-45f0-a62b-16db6c1e431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:47 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Volume volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b (c3e205a9-2155-4afa-baf1-7204bde1dd1b): created successfully
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda0fbb0-8699-45f0-a62b-16db6c1e431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (df1a9b5e-3099-463c-a1d4-104f8544d31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c9c681dc-8e74-4061-9d3c-7f838fb88add tempest-AttachVolumeTestJSON-903926484 None] Created volume successfully.
Sep 20 16:50:48 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1073741824" returned: 0 in 0.547s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:48 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:48 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:48 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 0 in 0.342s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Attempting download of 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume 102e30d0-95a6-4a7d-81a2-d64c602d2363. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ada249-84ad-4157-8def-7abb797f83af]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:48 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x
Sep 20 16:50:48 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:48 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x" returned: 0 in 0.425s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:49 devstack sudo[89138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x
Sep 20 16:50:49 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:49 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x" returned: 1 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_kbblec0x' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887851e-9dea-4e58-8053-a6b76a970810]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3085c4be-ca8e-47f1-983e-1892310dc554]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:49 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD
Sep 20 16:50:49 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:49 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b
Sep 20 16:50:49 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:49 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 16:50:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:49 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:49 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:49 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b" returned: 0 in 0.537s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.562s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '685fd090-c5d7-47a4-b5c3-c4a2b470ed29', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:50:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-a626111e-9502-45bf-8940-49cd0b4be2cc req-2deefe23-32f3-42d6-811e-86261e81a9b3 tempest-AttachVolumeTestJSON-903926484 None] attachment_update completed successfully.
Sep 20 16:50:51 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 0 in 2.026s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:51 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_go81emjedevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:50:51 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Converted 112.00 MB image at 55.25 MB/s
Sep 20 16:50:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:51 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1G
Sep 20 16:50:51 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:52 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 1G" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d38c8-d01f-4401-8c82-a6651eac12f7]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:52 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:52 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:52 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 0 in 0.442s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:52 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:52 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:53 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 1 in 0.521s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Downloaded image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume 102e30d0-95a6-4a7d-81a2-d64c602d2363 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 for user 15dafb5ea1a94249a62f632db904b306 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Marking volume 102e30d0-95a6-4a7d-81a2-d64c602d2363 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Copying metadata from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 to 102e30d0-95a6-4a7d-81a2-d64c602d2363. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Creating volume glance metadata for volume 102e30d0-95a6-4a7d-81a2-d64c602d2363 backed by image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0ff1e4-4df0-40b5-a1d2-cbee44a67b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102e30d0-95a6-4a7d-81a2-d64c602d2363', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fd4ff20>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e817dca7-47ad-402e-95d6-4906dca30c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:50:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Volume volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 (102e30d0-95a6-4a7d-81a2-d64c602d2363): created successfully
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e817dca7-47ad-402e-95d6-4906dca30c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:50:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Flow 'volume_create_manager' (6347077b-15fd-4cc0-8a95-068dcc8bbae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:50:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-de281736-105b-4977-a91f-1050e449bdd7 tempest-VolumesImageMetadata-1524667974 None] Created volume successfully.
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Acquiring lock "cinder-102e30d0-95a6-4a7d-81a2-d64c602d2363-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "cinder-102e30d0-95a6-4a7d-81a2-d64c602d2363-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Acquiring lock "cinder-quobyte-102e30d0-95a6-4a7d-81a2-d64c602d2363" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "cinder-quobyte-102e30d0-95a6-4a7d-81a2-d64c602d2363" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[417aff6e-b341-47d8-8f4e-0aa7180914a0]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:55 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:55 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:55 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 0 in 0.466s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:55 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:55 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:56 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 1 in 0.488s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:56 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363
Sep 20 16:50:56 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:56 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-102e30d0-95a6-4a7d-81a2-d64c602d2363" returned: 0 in 0.301s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "cinder-quobyte-102e30d0-95a6-4a7d-81a2-d64c602d2363" released by "delete_volume" :: held 1.338s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Created reservations ['d29dedbc-c8cd-4626-91e7-c8e207cf6d7c', 'b80eb9d3-9672-485a-ace3-5b72a102157f', '3337779a-aa20-49c8-9642-0956bac4b4fd', 'a15b62fa-48cb-459e-acea-3e63af94fbe9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:56 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:50:56 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:56 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.318s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:56 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Deleted volume successfully.
Sep 20 16:50:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1d994cc9-1b7c-47f9-8c8d-2eab4e3a5b89 tempest-VolumesImageMetadata-1524667974 None] Lock "cinder-102e30d0-95a6-4a7d-81a2-d64c602d2363-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:50:58 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:50:58 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:50:58 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:50:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Flow 'volume_create_manager' (aeb632a5-f5a4-4445-ae6c-7bbb1293a3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1cd2c6-e022-4489-b24c-d1c628ca0c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1cd2c6-e022-4489-b24c-d1c628ca0c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1183204680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca46530b-785c-4725-9a00-ef63c427f6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea699730a6346de9f05c553c8549bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:03Z,use_quota=True,user_id='832989fe459c46da9a0d58d3f169ed86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037e241-e1bd-4f93-b02a-0d95b06672fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037e241-e1bd-4f93-b02a-0d95b06672fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09af3729-725e-42b6-aa41-a073bcdbba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09af3729-725e-42b6-aa41-a073bcdbba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca46530b-785c-4725-9a00-ef63c427f6d6', 'volume_name': 'volume-ca46530b-785c-4725-9a00-ef63c427f6d6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7faa787-575d-4d64-8bb8-5f81261dddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7faa787-575d-4d64-8bb8-5f81261dddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef5a1fb-7f1d-4726-ad7c-567c94aadac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:03 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Volume ca46530b-785c-4725-9a00-ef63c427f6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca46530b-785c-4725-9a00-ef63c427f6d6', 'volume_size': 1}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1183204680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca46530b-785c-4725-9a00-ef63c427f6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea699730a6346de9f05c553c8549bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:03Z,use_quota=True,user_id='832989fe459c46da9a0d58d3f169ed86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Creating volume ca46530b-785c-4725-9a00-ef63c427f6d6 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:03 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:03 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 1073741824
Sep 20 16:51:03 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:04 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 1073741824" returned: 0 in 0.657s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:04 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6
Sep 20 16:51:04 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:04 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6" returned: 0 in 0.531s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef5a1fb-7f1d-4726-ad7c-567c94aadac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca46530b-785c-4725-9a00-ef63c427f6d6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6947e9e8-9e67-45b9-a5de-7c358484466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Volume volume-ca46530b-785c-4725-9a00-ef63c427f6d6 (ca46530b-785c-4725-9a00-ef63c427f6d6): created successfully
Sep 20 16:51:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6947e9e8-9e67-45b9-a5de-7c358484466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Flow 'volume_create_manager' (aeb632a5-f5a4-4445-ae6c-7bbb1293a3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-38a82485-4984-40c7-bbaf-3d8bdd25385b tempest-VolumesMetadataTest-1207744516 None] Created volume successfully.
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Acquiring lock "cinder-ca46530b-785c-4725-9a00-ef63c427f6d6-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "cinder-ca46530b-785c-4725-9a00-ef63c427f6d6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Acquiring lock "cinder-quobyte-ca46530b-785c-4725-9a00-ef63c427f6d6" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "cinder-quobyte-ca46530b-785c-4725-9a00-ef63c427f6d6" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf1ca9b-7d0c-4b8d-9b7b-066596073dc5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:08 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6
Sep 20 16:51:08 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:08 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6" returned: 0 in 0.634s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:08 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6
Sep 20 16:51:08 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:09 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ca46530b-785c-4725-9a00-ef63c427f6d6" returned: 0 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "cinder-quobyte-ca46530b-785c-4725-9a00-ef63c427f6d6" released by "delete_volume" :: held 1.233s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=52,cinder:SELECT=57,cinder:INSERT=14,cinder:DELETE=6 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Created reservations ['d7e64d2a-e379-4759-96b4-0164d23f22d9', 'aba59517-cc3e-4958-8c74-6df06a647d78', '5af92442-68f0-4406-bad7-e966971cdd37', '6d6a934f-97ba-477f-b1b0-64fb7ed85340'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:09 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:51:09 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:09 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.403s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:51:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Deleted volume successfully.
Sep 20 16:51:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f57cdc1-5e5f-4a20-8d29-b281e4c964a6 tempest-VolumesMetadataTest-1207744516 None] Lock "cinder-ca46530b-785c-4725-9a00-ef63c427f6d6-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:19 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:51:19 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=29,cinder:SELECT=31,cinder:INSERT=12,cinder:DELETE=3 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Flow 'volume_create_manager' (a4c56a33-8480-4e8f-9780-4b984940d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b773b6-e1e8-4195-b4d4-7b607c1712ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b773b6-e1e8-4195-b4d4-7b607c1712ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-827625487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63ea83c-f7ec-4d82-be41-591f5646b8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b826e4accd4994b6f74bdc21cfcaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:22Z,use_quota=True,user_id='e15fca9973e146138b40b7a3e2d92ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c2a42-9f0e-423a-8b03-b77d22cc5787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c2a42-9f0e-423a-8b03-b77d22cc5787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14d08f2-38a9-453a-aad4-9a6b3c365f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14d08f2-38a9-453a-aad4-9a6b3c365f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63ea83c-f7ec-4d82-be41-591f5646b8fd', 'volume_name': 'volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9024f1-a14b-4953-a2e6-d6f148154327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9024f1-a14b-4953-a2e6-d6f148154327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3df8ae1-746a-4bc1-a573-056c17527a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Volume a63ea83c-f7ec-4d82-be41-591f5646b8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd', 'volume_size': 1}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-827625487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63ea83c-f7ec-4d82-be41-591f5646b8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b826e4accd4994b6f74bdc21cfcaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:22Z,use_quota=True,user_id='e15fca9973e146138b40b7a3e2d92ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Creating volume a63ea83c-f7ec-4d82-be41-591f5646b8fd {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:21 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd 1073741824
Sep 20 16:51:21 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:22 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd 1073741824" returned: 0 in 0.872s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:22 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd
Sep 20 16:51:22 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:23 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3df8ae1-746a-4bc1-a573-056c17527a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac389c1-c003-43e4-8c8f-06cbb6da1d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Volume volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd (a63ea83c-f7ec-4d82-be41-591f5646b8fd): created successfully
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac389c1-c003-43e4-8c8f-06cbb6da1d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Flow 'volume_create_manager' (a4c56a33-8480-4e8f-9780-4b984940d66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ce091361-4f38-4ccf-b829-90607e1c5464 tempest-VolumesTransfersV357Test-985222829 None] Created volume successfully.
Sep 20 16:51:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ba350440-ec5d-46df-83db-4f33240d74f0 tempest-VolumesTransfersV357Test-395218285 None] Transfer volume completed successfully.
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "cinder-a63ea83c-f7ec-4d82-be41-591f5646b8fd-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-a63ea83c-f7ec-4d82-be41-591f5646b8fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "cinder-quobyte-a63ea83c-f7ec-4d82-be41-591f5646b8fd" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-quobyte-a63ea83c-f7ec-4d82-be41-591f5646b8fd" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0019db9-1637-4816-b55b-f35dec09b659]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:25 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd
Sep 20 16:51:25 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:25 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd" returned: 0 in 0.447s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:25 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd
Sep 20 16:51:25 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:25 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a63ea83c-f7ec-4d82-be41-591f5646b8fd" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-quobyte-a63ea83c-f7ec-4d82-be41-591f5646b8fd" released by "delete_volume" :: held 0.778s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Created reservations ['bc8457e0-2a05-4719-9269-340db18aba81', 'f35f014a-16ab-4f33-8ea0-954a115dbee5', 'b55377a3-7b95-4128-80d6-4224b5f0c304', '6994f729-3812-48fe-98a5-d6b6fde5ee66'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:26 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:51:26 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:26 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.287s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:51:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Deleted volume successfully.
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08aa44a2-9573-4a84-a042-b79df9077a77 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-a63ea83c-f7ec-4d82-be41-591f5646b8fd-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:26 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Flow 'volume_create_manager' (c61b44c0-60e1-44e7-8404-f00131dc23f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e98a15-807b-4b37-b227-01623b706c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e98a15-807b-4b37-b227-01623b706c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-320740358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe7c58-eee0-4d35-a049-413da965cbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b826e4accd4994b6f74bdc21cfcaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:27Z,use_quota=True,user_id='e15fca9973e146138b40b7a3e2d92ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f0171-c2da-4232-b3c3-82da2edf063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f0171-c2da-4232-b3c3-82da2edf063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb291390-76a4-413c-982c-8bbab6201eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb291390-76a4-413c-982c-8bbab6201eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efe7c58-eee0-4d35-a049-413da965cbd1', 'volume_name': 'volume-4efe7c58-eee0-4d35-a049-413da965cbd1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dc03ad-c09c-4056-9394-67503a91c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dc03ad-c09c-4056-9394-67503a91c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68528dc-9967-4dbd-90e0-59df8f4770b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Volume 4efe7c58-eee0-4d35-a049-413da965cbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efe7c58-eee0-4d35-a049-413da965cbd1', 'volume_size': 1}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-320740358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe7c58-eee0-4d35-a049-413da965cbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b826e4accd4994b6f74bdc21cfcaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:27Z,use_quota=True,user_id='e15fca9973e146138b40b7a3e2d92ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Creating volume 4efe7c58-eee0-4d35-a049-413da965cbd1 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:27 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:27 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 1073741824
Sep 20 16:51:27 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:27 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 1073741824" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:27 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1
Sep 20 16:51:27 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:27 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68528dc-9967-4dbd-90e0-59df8f4770b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efe7c58-eee0-4d35-a049-413da965cbd1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5db606-cb20-4686-8a09-06f98142eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Volume volume-4efe7c58-eee0-4d35-a049-413da965cbd1 (4efe7c58-eee0-4d35-a049-413da965cbd1): created successfully
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5db606-cb20-4686-8a09-06f98142eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Flow 'volume_create_manager' (c61b44c0-60e1-44e7-8404-f00131dc23f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cab62a19-f256-4f51-be47-dd92aafc8f08 tempest-VolumesTransfersV357Test-985222829 None] Created volume successfully.
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "cinder-4efe7c58-eee0-4d35-a049-413da965cbd1-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-4efe7c58-eee0-4d35-a049-413da965cbd1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "cinder-quobyte-4efe7c58-eee0-4d35-a049-413da965cbd1" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-quobyte-4efe7c58-eee0-4d35-a049-413da965cbd1" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52dd5f-39d0-4d2c-84e6-b3b8706c1e33]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:29 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1
Sep 20 16:51:29 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:30 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1" returned: 0 in 0.463s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:30 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1
Sep 20 16:51:30 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:30 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4efe7c58-eee0-4d35-a049-413da965cbd1" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-quobyte-4efe7c58-eee0-4d35-a049-413da965cbd1" released by "delete_volume" :: held 0.918s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Created reservations ['b1ff9605-6830-4e5a-b40e-9e45c6d79f1d', '09f14589-9aea-4325-9f4b-a827dd1cd200', '096abe48-39f4-4535-9877-895a0d0f03a4', '808b5288-e40c-4e64-ae32-7450beeb84ce'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:30 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:51:30 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:31 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:31 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:51:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Deleted volume successfully.
Sep 20 16:51:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-116d9174-cbbe-4a4a-ba72-871415c311d4 tempest-VolumesTransfersV357Test-529403412 None] Lock "cinder-4efe7c58-eee0-4d35-a049-413da965cbd1-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Flow 'volume_create_manager' (41d8a253-bad8-47dc-8eb3-fd45d19a03e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7bf7dc-c8f3-441c-ab74-2d9f0e50a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7bf7dc-c8f3-441c-ab74-2d9f0e50a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-619868598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f8b074-2064-4351-ad98-8b3cfecf17b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572f6d91619d4f2abff4f93fc843eddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:38Z,use_quota=True,user_id='5100f3f3c50940eda05de5511b55ad89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eebd35-31cb-4cc6-87a9-fc5e8afef9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eebd35-31cb-4cc6-87a9-fc5e8afef9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb3fdc-5c8a-4a38-b983-2d53819e9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb3fdc-5c8a-4a38-b983-2d53819e9745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'volume_name': 'volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436e5853-27d9-4590-9400-1f98d5b22df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436e5853-27d9-4590-9400-1f98d5b22df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b8033-f228-490c-ba8c-83471010b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:37 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Volume c9f8b074-2064-4351-ad98-8b3cfecf17b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'volume_size': 1}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-619868598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f8b074-2064-4351-ad98-8b3cfecf17b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572f6d91619d4f2abff4f93fc843eddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:38Z,use_quota=True,user_id='5100f3f3c50940eda05de5511b55ad89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Creating volume c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:37 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:37 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 1073741824
Sep 20 16:51:37 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:38 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 1073741824" returned: 0 in 0.400s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:38 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:38 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:38 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b8033-f228-490c-ba8c-83471010b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6f1fe8-f369-46ba-a903-613b78e18d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:38 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Volume volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 (c9f8b074-2064-4351-ad98-8b3cfecf17b6): created successfully
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6f1fe8-f369-46ba-a903-613b78e18d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Flow 'volume_create_manager' (41d8a253-bad8-47dc-8eb3-fd45d19a03e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2d526fba-acb4-446d-81bd-fffa27aa5a32 tempest-VolumesCloneTest-898268782 None] Created volume successfully.
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Flow 'volume_create_manager' (b3b111e6-d44e-4ef7-b0d3-7a61d5fc935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d292f9bb-4be7-405e-b94b-b347a255dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d292f9bb-4be7-405e-b94b-b347a255dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-47271334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d21612-050c-42ab-95a9-bbd13fb4f57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572f6d91619d4f2abff4f93fc843eddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c9f8b074-2064-4351-ad98-8b3cfecf17b6,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:39Z,use_quota=True,user_id='5100f3f3c50940eda05de5511b55ad89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4f04aa-5716-448d-b239-e4b22677d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4f04aa-5716-448d-b239-e4b22677d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161fd55e-8fdc-44a4-9f21-c7e7cb1d8db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161fd55e-8fdc-44a4-9f21-c7e7cb1d8db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c8d21612-050c-42ab-95a9-bbd13fb4f57f', 'volume_name': 'volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f', 'volume_size': 2, 'source_volid': 'c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'source_volstatus': 'available'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea400e-0242-4a26-a343-53d21d39ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea400e-0242-4a26-a343-53d21d39ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1677451-8efd-42f1-80a9-24f05682fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:39 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Volume c8d21612-050c-42ab-95a9-bbd13fb4f57f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f', 'volume_size': 2, 'source_volid': 'c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'source_volstatus': 'available'}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:39 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Cloning volume c9f8b074-2064-4351-ad98-8b3cfecf17b6 to volume c8d21612-050c-42ab-95a9-bbd13fb4f57f
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Creating offline snapshot a7459552-4ede-4234-b09b-15e08563aa87 of volume c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ce9218-ef89-43c9-b59a-b4ed5bc4dcac]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:39 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:39 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:39 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:39 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 1G
Sep 20 16:51:39 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:40 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 1G" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:40 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:40 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:40 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.342s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:40 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 is being set with open permissions: ugo+rw
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:40 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:40 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:40 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:40 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info
Sep 20 16:51:40 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:41 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info" returned: 0 in 0.253s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:41 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info is being set with open permissions: ugo+rw
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:41 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info
Sep 20 16:51:41 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:41 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.info" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] snapshot: a7459552-4ede-4234-b09b-15e08563aa87, volume: c8d21612-050c-42ab-95a9-bbd13fb4f57f,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f973571-44b1-46c1-b586-96efe659a720]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:41 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:41 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:41 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.364s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[db485a5a-14e2-410e-bbae-f86522bf7c5f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:41 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:41 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:42 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.351s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:42 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 16:51:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:42 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f
Sep 20 16:51:42 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Flow 'volume_create_manager' (6fa60ef2-6b68-401c-88c3-a27921050b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95f6e54-225a-44d1-9f9e-bf3eaac97d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95f6e54-225a-44d1-9f9e-bf3eaac97d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1759074061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c0067a-e73b-4899-a8ae-dd0542e64425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d721399cbf4088ac9b66b0f888c088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:44Z,use_quota=True,user_id='fba3a4af599e46aa835ebb94c5fc5483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe70e1b-d116-446a-8f97-07d1b7f6426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe70e1b-d116-446a-8f97-07d1b7f6426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b44f26-ec9a-4bf9-81b5-d7d9f2015f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b44f26-ec9a-4bf9-81b5-d7d9f2015f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c0067a-e73b-4899-a8ae-dd0542e64425', 'volume_name': 'volume-b5c0067a-e73b-4899-a8ae-dd0542e64425', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbd387c-66b8-46ea-bd0f-e4e1e3302176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbd387c-66b8-46ea-bd0f-e4e1e3302176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c83c6-527d-4387-8890-ebccc05e6cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:44 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Volume b5c0067a-e73b-4899-a8ae-dd0542e64425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c0067a-e73b-4899-a8ae-dd0542e64425', 'volume_size': 1}
Sep 20 16:51:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Flow 'volume_create_manager' (8f410456-51af-42ac-babe-3f9d2477b660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127531b0-577d-4a07-b549-b04c3e52ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127531b0-577d-4a07-b549-b04c3e52ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-368249697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da9941-f64d-4b07-a1e4-d15ab57a08e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452730afb0574b32b3a622943d99bba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:45Z,use_quota=True,user_id='64ddae4fdb7a4e02811912c337ea9bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dba47a2-cbef-424b-b57d-695fd054ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dba47a2-cbef-424b-b57d-695fd054ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfa8234-cae6-40ff-98ee-109c2050f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfa8234-cae6-40ff-98ee-109c2050f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'volume_name': 'volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c651df-b9a0-41a8-a7e2-2c14f28b1b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c651df-b9a0-41a8-a7e2-2c14f28b1b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6bca16-5ebd-41c6-a979-5a31ca59f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Volume a2da9941-f64d-4b07-a1e4-d15ab57a08e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'volume_size': 1}
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-e6ec6b1f-71a1-4f53-93cf-0912e37c06ac req-2b139ada-0801-47fe-b9fb-057db612daa8 tempest-AttachVolumeTestJSON-903926484 None] Terminate volume connection completed successfully.
Sep 20 16:51:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e6ec6b1f-71a1-4f53-93cf-0912e37c06ac req-2b139ada-0801-47fe-b9fb-057db612daa8 tempest-AttachVolumeTestJSON-903926484 None] Deleting attachment 685fd090-c5d7-47a4-b5c3-c4a2b470ed29. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:51:50 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f" returned: 0 in 8.676s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:50 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e62f05-7479-4732-82fa-a85645eedbd6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:51 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:51 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:51 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.809s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:51 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:51:51 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Converted 1024.00 MB image at 118.01 MB/s
Sep 20 16:51:51 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f is being set with open permissions: ugo+rw
Sep 20 16:51:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:51 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f
Sep 20 16:51:51 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:52 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f" returned: 0 in 0.329s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" released by "_copy_volume_from_snapshot" :: held 10.636s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-quobyte-a7459552-4ede-4234-b09b-15e08563aa87" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-a7459552-4ede-4234-b09b-15e08563aa87" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Deleting offline snapshot a7459552-4ede-4234-b09b-15e08563aa87 of volume c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] snapshot_file for this snap is: volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d98f52-e577-4719-b07f-a18ae4162a4e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:52 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:52 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:52 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.682s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d2230-a995-4246-b9d7-179da3226fbf]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:53 devstack sudo[90735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:53 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:53 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.430s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:53 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:53 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:53 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.587s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:53 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87
Sep 20 16:51:53 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:54 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6.a7459552-4ede-4234-b09b-15e08563aa87" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-a7459552-4ede-4234-b09b-15e08563aa87" released by "_delete_snapshot" :: held 2.174s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.054s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.094s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1759074061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c0067a-e73b-4899-a8ae-dd0542e64425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d721399cbf4088ac9b66b0f888c088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:44Z,use_quota=True,user_id='fba3a4af599e46aa835ebb94c5fc5483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Creating volume b5c0067a-e73b-4899-a8ae-dd0542e64425 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:54 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:54 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 1073741824
Sep 20 16:51:54 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1677451-8efd-42f1-80a9-24f05682fec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f', 'volume_size': 2, 'source_volid': 'c9f8b074-2064-4351-ad98-8b3cfecf17b6', 'source_volstatus': 'available'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c46eba4-0660-4b9a-b701-d3c7f8d9f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Volume volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f (c8d21612-050c-42ab-95a9-bbd13fb4f57f): created successfully
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c46eba4-0660-4b9a-b701-d3c7f8d9f050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Flow 'volume_create_manager' (b3b111e6-d44e-4ef7-b0d3-7a61d5fc935d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a7ebe348-78d5-4167-98b3-c9d352a6d9d8 tempest-VolumesCloneTest-898268782 None] Created volume successfully.
Sep 20 16:51:54 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 1073741824" returned: 0 in 0.599s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:55 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425
Sep 20 16:51:55 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-c8d21612-050c-42ab-95a9-bbd13fb4f57f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "cinder-c8d21612-050c-42ab-95a9-bbd13fb4f57f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dad598-c805-46f8-a29f-a1f83d2228a5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:55 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425" returned: 0 in 0.430s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.179s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-368249697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da9941-f64d-4b07-a1e4-d15ab57a08e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452730afb0574b32b3a622943d99bba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:51:45Z,use_quota=True,user_id='64ddae4fdb7a4e02811912c337ea9bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Creating volume a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:51:55 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c83c6-527d-4387-8890-ebccc05e6cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c0067a-e73b-4899-a8ae-dd0542e64425', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e4a98-28f4-42bf-857a-9388d944f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:55 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 1073741824
Sep 20 16:51:55 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Volume volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 (b5c0067a-e73b-4899-a8ae-dd0542e64425): created successfully
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e4a98-28f4-42bf-857a-9388d944f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Flow 'volume_create_manager' (6fa60ef2-6b68-401c-88c3-a27921050b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-21c1ebe3-5416-4f47-ab3f-da60f423a6cc tempest-AttachVolumeShelveTestJSON-268556939 None] Created volume successfully.
Sep 20 16:51:55 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f
Sep 20 16:51:55 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:55 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f" returned: 0 in 0.521s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:55 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f
Sep 20 16:51:55 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:56 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 1073741824" returned: 0 in 0.689s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:56 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0
Sep 20 16:51:56 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:56 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c8d21612-050c-42ab-95a9-bbd13fb4f57f" returned: 0 in 0.384s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c8d21612-050c-42ab-95a9-bbd13fb4f57f" released by "delete_volume" :: held 1.016s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Created reservations ['115fb66a-ed2d-4474-b7f0-c510fdc76d72', '9164ed17-81eb-4504-b605-14d1e246fd0b', 'f61e5d14-af66-49ef-b42d-f7c9d163eed5', '56defa4a-bc5b-4c8f-bb08-6357076d263b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:56 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:56 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:51:56 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6bca16-5ebd-41c6-a979-5a31ca59f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f44793-0e3d-456a-9f62-d591d0beb3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:51:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Volume volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 (a2da9941-f64d-4b07-a1e4-d15ab57a08e0): created successfully
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f44793-0e3d-456a-9f62-d591d0beb3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:51:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Flow 'volume_create_manager' (8f410456-51af-42ac-babe-3f9d2477b660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:51:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a4d2f377-2f28-4875-a42d-04817dfeb0aa tempest-ServerActionsTestOtherA-456319338 None] Created volume successfully.
Sep 20 16:51:57 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.427s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:51:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Deleted volume successfully.
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5f84f581-1fd1-4cda-9db7-4617b3231834 tempest-VolumesCloneTest-898268782 None] Lock "cinder-c8d21612-050c-42ab-95a9-bbd13fb4f57f-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-c9f8b074-2064-4351-ad98-8b3cfecf17b6-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-c9f8b074-2064-4351-ad98-8b3cfecf17b6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "cinder-quobyte-c9f8b074-2064-4351-ad98-8b3cfecf17b6" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c9f8b074-2064-4351-ad98-8b3cfecf17b6" acquired by "delete_volume" :: waited 0.075s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e308de8-9853-4f44-8a5d-b13cfa82d515]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:51:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:58 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:58 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:58 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:51:58 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:59 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.903s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:51:59 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 1.059s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:51:59 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6
Sep 20 16:51:59 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:51:59 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9f8b074-2064-4351-ad98-8b3cfecf17b6" returned: 0 in 0.544s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:51:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-quobyte-c9f8b074-2064-4351-ad98-8b3cfecf17b6" released by "delete_volume" :: held 1.784s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Created reservations ['5eb071e4-91e3-4238-b625-f0eb1974af78', '943046b5-0c43-4831-9acc-ff0e71608610', 'e2b7a753-4794-4b6e-9c3c-cbd40988d0bc', '7c158fad-7706-4812-b5e9-e2726769b35f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:00 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:00 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:00 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Deleted volume successfully.
Sep 20 16:52:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-47bd08f1-4ae6-4dc1-ba7e-c8ae759af2f8 tempest-VolumesCloneTest-898268782 None] Lock "cinder-c9f8b074-2064-4351-ad98-8b3cfecf17b6-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:10 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=35,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=4 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:52:10 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=39,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=6 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:52:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-ffc979b2-7d28-47a1-8442-7814418a6739 req-27d74050-e4ad-411f-98d4-bc502efb3949 tempest-AttachVolumeShelveTestJSON-268556939 None] No connector for attachment 3f0a9770-a15f-412d-b989-dbf717eef2ef; skipping storage backend terminate_connection call. {{(pid=85945) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 20 16:52:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-ffc979b2-7d28-47a1-8442-7814418a6739 req-27d74050-e4ad-411f-98d4-bc502efb3949 tempest-AttachVolumeShelveTestJSON-268556939 None] Deleting attachment 3f0a9770-a15f-412d-b989-dbf717eef2ef. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (aaa35c07-2ed0-4003-af18-2611b55c893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0c4867-584b-429b-b360-aec67a64bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0c4867-584b-429b-b360-aec67a64bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035450663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c1f32-77e7-4e2e-9bf3-b63974f9a758,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:12Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331acd28-4a4a-453c-be71-987159c7889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331acd28-4a4a-453c-be71-987159c7889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cadd3f-0e12-4930-bc4c-4af43e63f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cadd3f-0e12-4930-bc4c-4af43e63f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c1f32-77e7-4e2e-9bf3-b63974f9a758', 'volume_name': 'volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4e8568-b0d1-4d59-9093-bddc2e647619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4e8568-b0d1-4d59-9093-bddc2e647619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c6dddc-1da2-43d1-9668-b3c444c36f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Volume c73c1f32-77e7-4e2e-9bf3-b63974f9a758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758', 'volume_size': 1}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035450663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c1f32-77e7-4e2e-9bf3-b63974f9a758,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:12Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Creating volume c73c1f32-77e7-4e2e-9bf3-b63974f9a758 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:52:12 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:12 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 1073741824
Sep 20 16:52:12 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:12 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 1073741824" returned: 0 in 0.516s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:12 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758
Sep 20 16:52:12 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:13 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c6dddc-1da2-43d1-9668-b3c444c36f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d461eb11-46db-4801-8ef0-da6a860e5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Volume volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 (c73c1f32-77e7-4e2e-9bf3-b63974f9a758): created successfully
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d461eb11-46db-4801-8ef0-da6a860e5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (aaa35c07-2ed0-4003-af18-2611b55c893a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-76be9233-c3c6-44e1-a4aa-61839aada823 tempest-VolumesListTestJSON-598677487 None] Created volume successfully.
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (89d13c87-cd4f-4911-80e2-e7146cd406a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e4b1a7-bc67-4316-9be0-d366b300539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e4b1a7-bc67-4316-9be0-d366b300539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1147245565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc5c70d-b013-4c5a-8b0a-eea553cf8587,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:15Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e20fe38-5cc2-4fa8-822e-89514bedfce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e20fe38-5cc2-4fa8-822e-89514bedfce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a89e23e-baa4-4f71-b967-bd7bac7004b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a89e23e-baa4-4f71-b967-bd7bac7004b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc5c70d-b013-4c5a-8b0a-eea553cf8587', 'volume_name': 'volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fe387b-a06e-4328-8d12-823d990725f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fe387b-a06e-4328-8d12-823d990725f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de48387-ddd9-4e19-8793-bc84ba98cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Volume fcc5c70d-b013-4c5a-8b0a-eea553cf8587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587', 'volume_size': 1}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1147245565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc5c70d-b013-4c5a-8b0a-eea553cf8587,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:15Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Creating volume fcc5c70d-b013-4c5a-8b0a-eea553cf8587 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:52:14 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:52:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:15 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 1073741824
Sep 20 16:52:15 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:15 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 1073741824" returned: 0 in 0.658s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:15 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587
Sep 20 16:52:15 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:16 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" returned: 0 in 0.357s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de48387-ddd9-4e19-8793-bc84ba98cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a6357-a0c4-499c-b114-84ce2114420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Volume volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 (fcc5c70d-b013-4c5a-8b0a-eea553cf8587): created successfully
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a6357-a0c4-499c-b114-84ce2114420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (89d13c87-cd4f-4911-80e2-e7146cd406a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dde041d8-dd8f-45ff-a87b-bdb6b3426bc4 tempest-VolumesListTestJSON-598677487 None] Created volume successfully.
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (a37a28ab-30e4-413a-acb8-8a13fe53fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6486757b-9917-466c-a3d1-e491bf5bb8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6486757b-9917-466c-a3d1-e491bf5bb8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1195699626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de764c1d-40f6-4dcf-b494-10fefd9f5868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:17Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d795b3a4-2590-4d1c-a278-358732e775f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d795b3a4-2590-4d1c-a278-358732e775f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb3767-8124-4450-8d05-495f32d60900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb3767-8124-4450-8d05-495f32d60900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de764c1d-40f6-4dcf-b494-10fefd9f5868', 'volume_name': 'volume-de764c1d-40f6-4dcf-b494-10fefd9f5868', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5df63c-a681-4954-96a9-def972455956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5df63c-a681-4954-96a9-def972455956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d72b98-b9fd-4169-9325-2062af17c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Volume de764c1d-40f6-4dcf-b494-10fefd9f5868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de764c1d-40f6-4dcf-b494-10fefd9f5868', 'volume_size': 1}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1195699626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de764c1d-40f6-4dcf-b494-10fefd9f5868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff4db798430f42c898e240d96c304cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:17Z,use_quota=True,user_id='b86f6768cf974dd698457d4eb996a1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Creating volume de764c1d-40f6-4dcf-b494-10fefd9f5868 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:52:17 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:52:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:17 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 1073741824
Sep 20 16:52:17 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:17 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 1073741824" returned: 0 in 0.422s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:18 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868
Sep 20 16:52:18 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:18 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d72b98-b9fd-4169-9325-2062af17c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de764c1d-40f6-4dcf-b494-10fefd9f5868', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55731657-dba9-435c-bc0b-b5b6111aae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Volume volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 (de764c1d-40f6-4dcf-b494-10fefd9f5868): created successfully
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55731657-dba9-435c-bc0b-b5b6111aae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Flow 'volume_create_manager' (a37a28ab-30e4-413a-acb8-8a13fe53fe29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e16e74b3-575f-4f26-962c-86503ebafb6e tempest-VolumesListTestJSON-598677487 None] Created volume successfully.
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-de764c1d-40f6-4dcf-b494-10fefd9f5868-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-de764c1d-40f6-4dcf-b494-10fefd9f5868-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-quobyte-de764c1d-40f6-4dcf-b494-10fefd9f5868" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-de764c1d-40f6-4dcf-b494-10fefd9f5868" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffca7aa6-c098-4034-966a-a7497f65fd82]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:21 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868
Sep 20 16:52:21 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:22 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868" returned: 0 in 0.553s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:22 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868
Sep 20 16:52:22 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:22 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de764c1d-40f6-4dcf-b494-10fefd9f5868" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-de764c1d-40f6-4dcf-b494-10fefd9f5868" released by "delete_volume" :: held 0.899s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Created reservations ['f1fcc2cd-95f3-4b42-b65f-03ab4ba416e9', 'fc622391-69f3-47d9-a95e-563c7a9566c1', 'dd1b2a54-95bd-400d-8807-c5705b84e069', '6c12ebaf-a0ed-4621-8b3b-81eeec095f4e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:22 devstack sudo[91082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:22 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:23 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Deleted volume successfully.
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe73bb1b-312e-42c7-85c1-174bdb5d3d35 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-de764c1d-40f6-4dcf-b494-10fefd9f5868-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-fcc5c70d-b013-4c5a-8b0a-eea553cf8587-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-fcc5c70d-b013-4c5a-8b0a-eea553cf8587-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-quobyte-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e8449-12a6-43d1-a48d-a5893dfe4b97]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:24 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587
Sep 20 16:52:24 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:24 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" returned: 0 in 0.399s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:24 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587
Sep 20 16:52:24 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:24 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-fcc5c70d-b013-4c5a-8b0a-eea553cf8587" released by "delete_volume" :: held 0.739s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Created reservations ['a8a8d917-edd3-401e-843a-0c3275738843', 'd4e5c87c-0b05-4d40-ba16-a497d41f9bf8', 'ebd548d3-71ba-4681-b0c7-a4e380fae331', 'b441a007-fc27-482e-973b-081a5e090298'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:24 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:24 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:25 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Deleted volume successfully.
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-c73c1f32-77e7-4e2e-9bf3-b63974f9a758-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-c73c1f32-77e7-4e2e-9bf3-b63974f9a758-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-aac26ad5-1d2c-4774-9a40-ab093b81b157 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-fcc5c70d-b013-4c5a-8b0a-eea553cf8587-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "cinder-quobyte-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3504c35-48ca-4cad-8766-83c09ca0dc84]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:25 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758
Sep 20 16:52:25 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a8734-184f-4e52-abe4-d0ba75102ff1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:25 devstack sudo[91113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0
Sep 20 16:52:25 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:25 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" returned: 0 in 0.382s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:25 devstack sudo[91118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758
Sep 20 16:52:25 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:25 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" returned: 0 in 0.380s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.400s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3285b84c-3dec-4221-ba53-68ce94db0758', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:52:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-de2332e4-16fe-4db6-9f48-abc493041970 req-3743eee9-dc80-4eb3-a716-34809968d105 tempest-ServerActionsTestOtherA-456319338 None] attachment_update completed successfully.
Sep 20 16:52:26 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-quobyte-c73c1f32-77e7-4e2e-9bf3-b63974f9a758" released by "delete_volume" :: held 0.704s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Created reservations ['c9b87b70-2472-4626-99aa-bc4854c81a4b', 'b8a2f316-d4f1-432f-a58d-87752b4954dd', '8bb38075-77da-4c74-8eaa-8df3ef18dcbe', '91a44804-0648-4bfb-bcd3-e321dd36c27d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:26 devstack sudo[91148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:26 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:26 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Deleted volume successfully.
Sep 20 16:52:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75977f90-c41e-4788-9a7b-7e581e2abd66 tempest-VolumesListTestJSON-598677487 None] Lock "cinder-c73c1f32-77e7-4e2e-9bf3-b63974f9a758-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:29 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-54ce3a24-56a9-45ae-84ef-68ca687bbfca tempest-ServerActionsTestOtherA-456319338 None] Terminate volume connection completed successfully.
Sep 20 16:52:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-54ce3a24-56a9-45ae-84ef-68ca687bbfca tempest-ServerActionsTestOtherA-456319338 None] Deleting attachment 3285b84c-3dec-4221-ba53-68ce94db0758. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Flow 'volume_create_manager' (25089940-4cd6-4ce9-bcf1-499860950514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12edfa6-701c-468c-84f1-de42d0f8a7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12edfa6-701c-468c-84f1-de42d0f8a7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93976119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427706ec2dd84a0fb13cdf18d2a055ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:31Z,use_quota=True,user_id='5d9e3272d36e428d8ed1c7c554d9014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624fa2f-809f-4fcd-9e7d-61fcd1a61179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624fa2f-809f-4fcd-9e7d-61fcd1a61179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbfb076-8fcd-4147-801d-e51eb2a54e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbfb076-8fcd-4147-801d-e51eb2a54e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f', 'volume_name': 'volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224a8b24-d104-47dd-ae20-de9d4e57902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224a8b24-d104-47dd-ae20-de9d4e57902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db67167e-8740-4881-8def-ab383554e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Volume 1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f', 'volume_size': 1}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93976119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427706ec2dd84a0fb13cdf18d2a055ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:52:31Z,use_quota=True,user_id='5d9e3272d36e428d8ed1c7c554d9014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Creating volume 1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:52:31 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:31 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f 1073741824
Sep 20 16:52:31 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:32 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f 1073741824" returned: 0 in 0.779s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:32 devstack sudo[91646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f
Sep 20 16:52:32 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:32 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.093s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db67167e-8740-4881-8def-ab383554e478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae68700a-e09c-4218-b75b-38ef0e11215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2506677-da50-4c00-a3db-9d0c9dcd1b23]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Volume volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f (1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f): created successfully
Sep 20 16:52:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae68700a-e09c-4218-b75b-38ef0e11215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:52:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Flow 'volume_create_manager' (25089940-4cd6-4ce9-bcf1-499860950514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:52:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1394be4d-6d6f-470d-980e-0b8572fc8e04 tempest-VolumesNegativeTest-1190917947 None] Created volume successfully.
Sep 20 16:52:33 devstack sudo[91656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0
Sep 20 16:52:33 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:33 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" returned: 0 in 0.900s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c75d9e2-6d00-43a8-82f7-dc5cf0426d48', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:52:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-b14d6983-6eed-4525-a480-6bc26eb881f7 req-50a49d01-5b89-4e7b-9b82-ac06c84e628a tempest-ServerActionsTestOtherA-456319338 None] attachment_update completed successfully.
Sep 20 16:52:44 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=6 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:52:44 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=34,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=4 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Acquiring lock "cinder-b5c0067a-e73b-4899-a8ae-dd0542e64425-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "cinder-b5c0067a-e73b-4899-a8ae-dd0542e64425-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Acquiring lock "cinder-quobyte-b5c0067a-e73b-4899-a8ae-dd0542e64425" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "cinder-quobyte-b5c0067a-e73b-4899-a8ae-dd0542e64425" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde04777-2501-44d4-82dd-1d21323ddd56]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:52:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:52 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425
Sep 20 16:52:52 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:53 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425" returned: 0 in 0.449s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:53 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425
Sep 20 16:52:53 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:53 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5c0067a-e73b-4899-a8ae-dd0542e64425" returned: 0 in 0.335s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "cinder-quobyte-b5c0067a-e73b-4899-a8ae-dd0542e64425" released by "delete_volume" :: held 0.829s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Created reservations ['a42de456-4057-4bdb-92d0-289a3d34b70f', 'ac5853cf-d26a-4d2a-84e6-de8819551251', '0417c374-f421-480b-93f6-33ace466e93e', '2d629020-3df8-4463-b542-06cd1ac2476d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:53 devstack sudo[92452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:53 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:54 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:54 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Deleted volume successfully.
Sep 20 16:52:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e12053c0-0edd-40ce-af93-23b680497e69 tempest-AttachVolumeShelveTestJSON-268556939 None] Lock "cinder-b5c0067a-e73b-4899-a8ae-dd0542e64425-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:52:58 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:52:58 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:52:58 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.344s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:52:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:53:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Acquiring lock "cinder-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "cinder-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Acquiring lock "cinder-quobyte-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "cinder-quobyte-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc7bf6c-fbd4-4682-a1ef-28057ff40872]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:02 devstack sudo[92498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f
Sep 20 16:53:02 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:02 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" returned: 0 in 0.621s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:02 devstack sudo[92503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f
Sep 20 16:53:02 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:03 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "cinder-quobyte-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f" released by "delete_volume" :: held 0.975s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Created reservations ['4956c729-1b37-4833-a0f9-bca63dd883a2', '95dbbfa9-0a5f-4170-b6e1-258f6f3eb821', 'ebda3a61-9bf7-49dd-9aad-a83c12d9f435', '704d0500-9105-4694-96cb-5d99df70ab14'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:03 devstack sudo[92506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:03 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:03 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Deleted volume successfully.
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0938fce6-c514-4353-83c0-3327aef68154 tempest-VolumesNegativeTest-1190917947 None] Lock "cinder-1ac857c7-385f-4a9b-8ad9-de7ed0b65a3f-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-748859db-5f13-4a84-a500-da6a177597cf req-89642ed0-1890-40be-8eba-f778e302aece tempest-ServerActionsTestOtherA-456319338 None] Terminate volume connection completed successfully.
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-748859db-5f13-4a84-a500-da6a177597cf req-89642ed0-1890-40be-8eba-f778e302aece tempest-ServerActionsTestOtherA-456319338 None] Deleting attachment 7c75d9e2-6d00-43a8-82f7-dc5cf0426d48. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Flow 'volume_create_manager' (1d43de8e-ec9b-43ad-8688-4ccfee967412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65208248-2971-4330-9a3c-57713ce31f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65208248-2971-4330-9a3c-57713ce31f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1530401882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48350b22-33f1-4e83-8358-139e7ffbc3f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e019ac53104fdaabc85145252f313a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:04Z,use_quota=True,user_id='978c921983e2435cacdbc69c00a6458f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bedd771-4c92-4243-a425-9295276582a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bedd771-4c92-4243-a425-9295276582a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a04679b-6838-4e86-9bb6-71fe35ef9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a04679b-6838-4e86-9bb6-71fe35ef9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48350b22-33f1-4e83-8358-139e7ffbc3f7', 'volume_name': 'volume-48350b22-33f1-4e83-8358-139e7ffbc3f7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6589163-2335-41fe-a5ce-cbab345460da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6589163-2335-41fe-a5ce-cbab345460da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98064d4-d724-489e-86df-04fc6584d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:04 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Volume 48350b22-33f1-4e83-8358-139e7ffbc3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48350b22-33f1-4e83-8358-139e7ffbc3f7', 'volume_size': 1}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1530401882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48350b22-33f1-4e83-8358-139e7ffbc3f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e019ac53104fdaabc85145252f313a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:04Z,use_quota=True,user_id='978c921983e2435cacdbc69c00a6458f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Creating volume 48350b22-33f1-4e83-8358-139e7ffbc3f7 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:04 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:04 devstack sudo[92513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 1073741824
Sep 20 16:53:04 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:04 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 1073741824" returned: 0 in 0.538s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:04 devstack sudo[92519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7
Sep 20 16:53:04 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:05 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7" returned: 0 in 0.440s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98064d4-d724-489e-86df-04fc6584d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48350b22-33f1-4e83-8358-139e7ffbc3f7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4130fba-635d-4dbd-8628-b1546fbea380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Volume volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 (48350b22-33f1-4e83-8358-139e7ffbc3f7): created successfully
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4130fba-635d-4dbd-8628-b1546fbea380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Flow 'volume_create_manager' (1d43de8e-ec9b-43ad-8688-4ccfee967412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-e78617f8-f262-4733-8e21-147ee6902844 req-90bcd7a8-83be-484e-a8fd-c2a5311437c8 tempest-VolumesGetTestJSON-358395868 None] Created volume successfully.
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Acquiring lock "cinder-48350b22-33f1-4e83-8358-139e7ffbc3f7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "cinder-48350b22-33f1-4e83-8358-139e7ffbc3f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Acquiring lock "cinder-quobyte-48350b22-33f1-4e83-8358-139e7ffbc3f7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "cinder-quobyte-48350b22-33f1-4e83-8358-139e7ffbc3f7" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb86ab0-b328-47b6-8e45-d3991e222df8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:07 devstack sudo[92577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7
Sep 20 16:53:07 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:07 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:07 devstack sudo[92582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7
Sep 20 16:53:07 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:07 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-48350b22-33f1-4e83-8358-139e7ffbc3f7" returned: 0 in 0.252s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "cinder-quobyte-48350b22-33f1-4e83-8358-139e7ffbc3f7" released by "delete_volume" :: held 0.726s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG cinder.quota [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Created reservations ['a69c3590-c902-431c-8aa5-cb773fded172', 'caec7cc1-6eb2-412c-a814-f213999f132e', 'd79650bd-bded-455e-bc7a-b687fd512376', 'fc91df0e-7095-45da-a705-403678bca72a'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:07 devstack sudo[92585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:07 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:08 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:08 devstack cinder-volume[85945]: DEBUG cinder.manager [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Deleted volume successfully.
Sep 20 16:53:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-72763e2e-2ae3-4cc3-88ee-ca868e32e66f req-0790da51-9465-4f55-91b9-aa118ecb9a96 tempest-VolumesGetTestJSON-358395868 None] Lock "cinder-48350b22-33f1-4e83-8358-139e7ffbc3f7-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Flow 'volume_create_manager' (627bbc49-d5dd-4b24-82fb-9443715788d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e82b51-5e4c-46b5-94e9-94523645461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e82b51-5e4c-46b5-94e9-94523645461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1138683921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac48d28d-f5dc-43af-bccd-930c9c379509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452730afb0574b32b3a622943d99bba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:11Z,use_quota=True,user_id='64ddae4fdb7a4e02811912c337ea9bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d040d1ab-d9e3-4345-85a2-2b5e405b08e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d040d1ab-d9e3-4345-85a2-2b5e405b08e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacb937-f323-449c-895e-b707b0f8c1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:10 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 16:53:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacb937-f323-449c-895e-b707b0f8c1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac48d28d-f5dc-43af-bccd-930c9c379509', 'volume_name': 'volume-ac48d28d-f5dc-43af-bccd-930c9c379509', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc90a10>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9faa7a-2a1e-47dc-9e0f-c8ea10594928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9faa7a-2a1e-47dc-9e0f-c8ea10594928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad7bef-8d4a-4232-905b-98f8b0e3b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Volume ac48d28d-f5dc-43af-bccd-930c9c379509: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac48d28d-f5dc-43af-bccd-930c9c379509', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc90a10>}
Sep 20 16:53:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Trying to clone ac48d28d-f5dc-43af-bccd-930c9c379509 from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 16:53:12 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Image download 20.69 MB at 20.69 MB/s
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec977693-5b63-4628-82cf-c09e88b2f91b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:12 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD
Sep 20 16:53:12 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:12 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 is fetched for user 64ddae4fdb7a4e02811912c337ea9bc4. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[109b1503-5f0d-4dad-a06d-954dd2c2a266]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:12 devstack sudo[92595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD
Sep 20 16:53:12 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:12 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1138683921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac48d28d-f5dc-43af-bccd-930c9c379509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452730afb0574b32b3a622943d99bba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:11Z,use_quota=True,user_id='64ddae4fdb7a4e02811912c337ea9bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Creating volume ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:13 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:13 devstack sudo[92600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1073741824
Sep 20 16:53:13 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7fb7ff80-79ac-4fc2-9c05-1ef685e2fc17 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-1873603783: creating
Sep 20 16:53:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7fb7ff80-79ac-4fc2-9c05-1ef685e2fc17 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-1873603783: created successfully
Sep 20 16:53:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7fb7ff80-79ac-4fc2-9c05-1ef685e2fc17 tempest-GroupSnapshotsTest-1935343413 None] Create group completed successfully.
Sep 20 16:53:13 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1073741824" returned: 0 in 0.729s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:13 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:13 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:14 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Attempting download of 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume ac48d28d-f5dc-43af-bccd-930c9c379509. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9380bd-55ff-4405-8151-c3d20e3e7464]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:14 devstack sudo[92609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4
Sep 20 16:53:14 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:14 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:14 devstack sudo[92613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4
Sep 20 16:53:14 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:14 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4" returned: 1 in 0.383s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_i5akj2i4' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fae8d2-2bed-470f-8749-0133ca28b627]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:14 devstack sudo[92617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD
Sep 20 16:53:14 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:15 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:15 devstack sudo[92623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:15 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (d30ba31b-ce9f-49bc-9b2e-10dc36de165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caad6a5b-027d-44e9-9bd9-53c156fbc637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caad6a5b-027d-44e9-9bd9-53c156fbc637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1981102784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04d96c19-bf82-4e75-9181-85a7f69802f5,host='devstack@QuobyteHD#QuobyteHD',id=f256a542-c7d7-497f-b3dd-f43f39d14d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:15Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a791fe5c-6c64-45b4-af64-5d741165f46f),volume_type_id=a791fe5c-6c64-45b4-af64-5d741165f46f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1725c3ab-16ad-4c0f-b082-1e45661723a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1725c3ab-16ad-4c0f-b082-1e45661723a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802bee8-fb17-4f02-80dd-8d55ef720ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802bee8-fb17-4f02-80dd-8d55ef720ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f256a542-c7d7-497f-b3dd-f43f39d14d9a', 'volume_name': 'volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cc8da4-ab9f-4f4d-8162-aeef2cd5530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cc8da4-ab9f-4f4d-8162-aeef2cd5530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c780ddca-49dd-4640-94a3-3dce1ee56ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Volume f256a542-c7d7-497f-b3dd-f43f39d14d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a', 'volume_size': 1}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=04d96c19-bf82-4e75-9181-85a7f69802f5,created_at=2026-09-20T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1981102784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04d96c19-bf82-4e75-9181-85a7f69802f5,host='devstack@QuobyteHD#QuobyteHD',id=f256a542-c7d7-497f-b3dd-f43f39d14d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:15Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a791fe5c-6c64-45b4-af64-5d741165f46f),volume_type_id=a791fe5c-6c64-45b4-af64-5d741165f46f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Creating volume f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:15 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:15 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a 1073741824
Sep 20 16:53:15 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:16 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a 1073741824" returned: 0 in 0.653s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:16 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:16 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:16 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c780ddca-49dd-4640-94a3-3dce1ee56ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad2934e-349e-4924-acf6-3424a896a485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Volume volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a (f256a542-c7d7-497f-b3dd-f43f39d14d9a): created successfully
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad2934e-349e-4924-acf6-3424a896a485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (d30ba31b-ce9f-49bc-9b2e-10dc36de165f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cbe5276b-197d-4b43-bf4e-0b3197d2620b tempest-GroupSnapshotsTest-1935343413 None] Created volume successfully.
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (e512b06f-8704-4e4c-bb79-755f3e8cae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aeb707-c428-426f-af9c-f77d614ebc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aeb707-c428-426f-af9c-f77d614ebc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-709482208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42178e5-209b-40cc-aa03-8ed4438e882e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:17Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f79563-0c93-42d5-bb62-d98d0e091807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f79563-0c93-42d5-bb62-d98d0e091807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fd4167-5206-412b-a0eb-14b3109a120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fd4167-5206-412b-a0eb-14b3109a120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42178e5-209b-40cc-aa03-8ed4438e882e', 'volume_name': 'volume-e42178e5-209b-40cc-aa03-8ed4438e882e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08ca072-84a4-4e42-be96-89cf2a614712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08ca072-84a4-4e42-be96-89cf2a614712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d3d970-97a1-4a51-b7ca-973f3ed09335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Volume e42178e5-209b-40cc-aa03-8ed4438e882e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42178e5-209b-40cc-aa03-8ed4438e882e', 'volume_size': 1}
Sep 20 16:53:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-709482208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42178e5-209b-40cc-aa03-8ed4438e882e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:17Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Creating volume e42178e5-209b-40cc-aa03-8ed4438e882e {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:17 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:17 devstack sudo[92642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e 1073741824
Sep 20 16:53:17 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:17 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 2.001s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_ne1b3ufkdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:53:17 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Converted 112.00 MB image at 55.95 MB/s
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:17 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1G
Sep 20 16:53:17 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:17 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e 1073741824" returned: 0 in 0.559s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:17 devstack sudo[92652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e
Sep 20 16:53:17 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:17 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 1G" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ce828-fea5-4c05-bad1-892060516a3e]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:18 devstack sudo[92655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:18 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:18 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e" returned: 0 in 0.437s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d3d970-97a1-4a51-b7ca-973f3ed09335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42178e5-209b-40cc-aa03-8ed4438e882e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e79557-37e6-4e84-8a56-2a1af062f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Volume volume-e42178e5-209b-40cc-aa03-8ed4438e882e (e42178e5-209b-40cc-aa03-8ed4438e882e): created successfully
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e79557-37e6-4e84-8a56-2a1af062f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (e512b06f-8704-4e4c-bb79-755f3e8cae8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6194899d-582a-46c1-b1f9-df16d64688e2 tempest-AttachVolumeTestJSON-903926484 None] Created volume successfully.
Sep 20 16:53:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] GroupSnapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: creating.
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Group snapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: creating. {{(pid=85945) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 20 16:53:18 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.666s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Creating offline snapshot 282b5511-a90a-4e16-a3dc-d09cf1731a52 of volume f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11e065-cce7-444b-b10a-9705ef930e45]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:18 devstack sudo[92660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:18 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:18 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:18 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:18 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 1 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Downloaded image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume ac48d28d-f5dc-43af-bccd-930c9c379509 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 for user 64ddae4fdb7a4e02811912c337ea9bc4 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Marking volume ac48d28d-f5dc-43af-bccd-930c9c379509 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Copying metadata from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 to ac48d28d-f5dc-43af-bccd-930c9c379509. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 16:53:18 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Creating volume glance metadata for volume ac48d28d-f5dc-43af-bccd-930c9c379509 backed by image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 16:53:19 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.473s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:19 devstack sudo[92674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 1G
Sep 20 16:53:19 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad7bef-8d4a-4232-905b-98f8b0e3b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac48d28d-f5dc-43af-bccd-930c9c379509', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc90a10>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450c2b24-5c8b-4eeb-8ad0-96da6cca239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Volume volume-ac48d28d-f5dc-43af-bccd-930c9c379509 (ac48d28d-f5dc-43af-bccd-930c9c379509): created successfully
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450c2b24-5c8b-4eeb-8ad0-96da6cca239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Flow 'volume_create_manager' (627bbc49-d5dd-4b24-82fb-9443715788d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-771e9d10-c9cd-47ba-88e5-73ceefcc9b39 tempest-ServerActionsTestOtherA-456319338 None] Created volume successfully.
Sep 20 16:53:19 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 1G" returned: 0 in 0.512s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:19 devstack sudo[92690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:19 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:19 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.347s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:19 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:19 devstack sudo[92695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:19 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:19 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (b8684e86-0528-450d-9338-875eb5998aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b872e07f-ce1c-42ba-b88c-e80b55aae6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b872e07f-ce1c-42ba-b88c-e80b55aae6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1850966481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becedf08-5758-4049-b21d-01b60d0f5536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:20Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3180e9b4-608c-489c-8aa7-e84314309919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3180e9b4-608c-489c-8aa7-e84314309919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897aed7f-4958-47f9-8b35-0a7f4980de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897aed7f-4958-47f9-8b35-0a7f4980de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becedf08-5758-4049-b21d-01b60d0f5536', 'volume_name': 'volume-becedf08-5758-4049-b21d-01b60d0f5536', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91985540-cd6b-496a-b94f-c023aa05997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91985540-cd6b-496a-b94f-c023aa05997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3108b6de-face-446a-8b31-15b74b751c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Volume becedf08-5758-4049-b21d-01b60d0f5536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becedf08-5758-4049-b21d-01b60d0f5536', 'volume_size': 1}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:20 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:20 devstack sudo[92698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info
Sep 20 16:53:20 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:20 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:20 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:20 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info
Sep 20 16:53:20 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:20 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.info" returned: 0 in 0.249s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.026s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[894c7b72-17df-4e18-85db-43cca0d59b7f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c550e1af-b212-4e38-b05c-7d3c4b536a1d tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: created successfully
Sep 20 16:53:20 devstack sudo[92704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e
Sep 20 16:53:20 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:21 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.420s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1850966481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becedf08-5758-4049-b21d-01b60d0f5536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:20Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Creating volume becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:21 devstack sudo[92712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 1073741824
Sep 20 16:53:21 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-e42178e5-209b-40cc-aa03-8ed4438e882e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6052328e-11a8-4c57-8f6c-196f1e2a23d0', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:53:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-950dfabe-1d48-4835-b454-9e4fb3984976 req-8e1c201f-a8aa-4c70-b355-a351be967350 tempest-AttachVolumeTestJSON-903926484 None] attachment_update completed successfully.
Sep 20 16:53:21 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 1073741824" returned: 0 in 0.578s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:21 devstack sudo[93131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536
Sep 20 16:53:21 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:22 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3108b6de-face-446a-8b31-15b74b751c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becedf08-5758-4049-b21d-01b60d0f5536', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7024c1-e83a-45ae-9076-9de46fdee303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Volume volume-becedf08-5758-4049-b21d-01b60d0f5536 (becedf08-5758-4049-b21d-01b60d0f5536): created successfully
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7024c1-e83a-45ae-9076-9de46fdee303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (b8684e86-0528-450d-9338-875eb5998aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ce4ec19e-c2b8-42ba-a3e8-8e3888b4679c tempest-VolumesSnapshotTestJSON-106406804 None] Created volume successfully.
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52-db55886a-904c-40d7-8160-e320304a05bc" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52-db55886a-904c-40d7-8160-e320304a05bc" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Creating volume db55886a-904c-40d7-8160-e320304a05bc from snapshot 282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] snapshot: 282b5511-a90a-4e16-a3dc-d09cf1731a52, volume: db55886a-904c-40d7-8160-e320304a05bc,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206250c-f3f5-41b3-9526-d39bd5a3291a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:23 devstack sudo[93142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:23 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:23 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.481s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e092ba-d241-414f-a934-9b7282a3475b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:23 devstack sudo[93147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:23 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (8a1907fd-0bdb-4e35-9fa3-d9e0a0a1f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1029f-0bb2-4d9d-98ac-67c467808cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1029f-0bb2-4d9d-98ac-67c467808cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1964775964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb93e9e-a307-4112-9241-dd21c549e0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:24Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a40113-f994-495e-b0c9-11448a43eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a40113-f994-495e-b0c9-11448a43eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6ef8f-11ec-41be-81ef-2184a68e56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6ef8f-11ec-41be-81ef-2184a68e56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb93e9e-a307-4112-9241-dd21c549e0c7', 'volume_name': 'volume-deb93e9e-a307-4112-9241-dd21c549e0c7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d999631-0174-4500-97f0-26fec08d101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d999631-0174-4500-97f0-26fec08d101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41a461d-b611-4251-926b-66ba299ee79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Volume deb93e9e-a307-4112-9241-dd21c549e0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb93e9e-a307-4112-9241-dd21c549e0c7', 'volume_size': 1}
Sep 20 16:53:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:23 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.488s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:24 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 16:53:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:24 devstack sudo[93152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc
Sep 20 16:53:24 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:30 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc" returned: 0 in 6.462s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60ba12-d527-4524-8572-a2e4281483eb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:30 devstack sudo[93168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:30 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:31 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.559s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:53:31 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Converted 1024.00 MB image at 158.45 MB/s
Sep 20 16:53:31 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:31 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc
Sep 20 16:53:31 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:31 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" released by "_copy_volume_from_snapshot" :: held 8.367s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52-db55886a-904c-40d7-8160-e320304a05bc" released by "_create_volume_from_snapshot" :: held 8.473s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.509s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.380s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff4d84-b031-4b6d-9d73-b6a5d8dc29dc]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fc7035a2-bfa4-4bd0-aae1-55b2727158ca tempest-GroupSnapshotsTest-1935343413 None] Create group from source-snapshot-8a8f74bd-048c-4de6-b42d-f3f42871fac5 completed successfully.
Sep 20 16:53:31 devstack sudo[93176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:31 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:31 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.346s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:31 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:31 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:32 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 1 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.271s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1964775964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb93e9e-a307-4112-9241-dd21c549e0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2decf8b6e44cb0b61a5555a0d80f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:24Z,use_quota=True,user_id='8d7beec658a442329d10380655d06b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Creating volume deb93e9e-a307-4112-9241-dd21c549e0c7 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:32 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:32 devstack sudo[93185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 1073741824
Sep 20 16:53:32 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-ac48d28d-f5dc-43af-bccd-930c9c379509', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277c965b-2f00-4ee7-8a63-31a613c104e2', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:53:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-c8ab4c18-613e-4fd0-9685-04f3b6b4d11a req-6cb7dd64-89f8-488c-9ca7-0127b6543ae4 tempest-ServerActionsTestOtherA-456319338 None] attachment_update completed successfully.
Sep 20 16:53:32 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 1073741824" returned: 0 in 0.478s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:32 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7
Sep 20 16:53:32 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" acquired by "delete_volume" :: waited 0.042s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07c70e-77a8-4f47-ae4c-9cb1290e9040]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:33 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7" returned: 0 in 0.495s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.938s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41a461d-b611-4251-926b-66ba299ee79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb93e9e-a307-4112-9241-dd21c549e0c7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f710f89-9842-4b89-b01d-b9f3d23f78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:33 devstack sudo[93219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc
Sep 20 16:53:33 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Creating offline snapshot 1e1692ec-3d14-4137-9419-c1f821120a40 of volume becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b845a33f-0d44-4b0a-b78f-b30fd11cd980]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Volume volume-deb93e9e-a307-4112-9241-dd21c549e0c7 (deb93e9e-a307-4112-9241-dd21c549e0c7): created successfully
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f710f89-9842-4b89-b01d-b9f3d23f78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Flow 'volume_create_manager' (8a1907fd-0bdb-4e35-9fa3-d9e0a0a1f68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-774cb4da-a901-4fcd-ba59-02eac1fb3993 tempest-AttachVolumeTestJSON-903926484 None] Created volume successfully.
Sep 20 16:53:33 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536
Sep 20 16:53:33 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:33 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc" returned: 0 in 0.693s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:33 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc
Sep 20 16:53:33 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:33 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536" returned: 0 in 0.556s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:33 devstack sudo[93251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 1G
Sep 20 16:53:33 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:34 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-db55886a-904c-40d7-8160-e320304a05bc" returned: 0 in 0.415s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-db55886a-904c-40d7-8160-e320304a05bc" released by "delete_volume" :: held 1.256s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['6a6d7c37-d1b4-43b6-935c-028ceabfad1e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:34 devstack cinder-volume[85945]: WARNING cinder.quota [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1281459925 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1281459925, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:53:34 devstack cinder-volume[85945]: WARNING cinder.quota [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1281459925 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1281459925, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['c5ae3867-2858-4286-8db0-0909967d0ad6', '5a7e636b-2e62-44b3-b476-1f46bf341db0', '68da29e8-18b6-4c28-8162-df25018bf872', 'b16f9941-1d40-4b43-883f-107e690da80b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:34 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 1G" returned: 0 in 0.768s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becedf08-5758-4049-b21d-01b60d0f5536 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:34 devstack sudo[93265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:34 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:34 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becedf08-5758-4049-b21d-01b60d0f5536 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40
Sep 20 16:53:34 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:35 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.541s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dc99dfdd-d53a-4fbd-87cd-62e8d85135ac tempest-GroupSnapshotsTest-1935343413 None] Delete group completed successfully.
Sep 20 16:53:35 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becedf08-5758-4049-b21d-01b60d0f5536 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40" returned: 0 in 0.695s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:35 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 is being set with open permissions: ugo+rw
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:35 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40
Sep 20 16:53:35 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:35 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40" returned: 0 in 0.332s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:35 devstack sudo[93296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info
Sep 20 16:53:35 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: deleting
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: deleting {{(pid=85945) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Deleting offline snapshot 282b5511-a90a-4e16-a3dc-d09cf1731a52 of volume f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] snapshot_file for this snap is: volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fbae84-5d1e-456e-967c-b75b294e925b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:36 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info" returned: 0 in 0.446s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:36 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info is being set with open permissions: ugo+rw
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:36 devstack sudo[93300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info
Sep 20 16:53:36 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:36 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:36 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:36 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.info" returned: 0 in 0.270s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.457s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[00865833-23b6-4b57-a25a-14d771ec71b3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:36 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.568s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[28713c65-bfa9-4b50-aa7a-34447878bab3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:36 devstack sudo[93307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7
Sep 20 16:53:36 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-10e1e671-5557-4780-99dd-a889b6a3fc90 tempest-VolumesSnapshotTestJSON-106406804 None] Create snapshot completed successfully
Sep 20 16:53:36 devstack sudo[93309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:36 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:36 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7" returned: 0 in 0.529s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.572s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-deb93e9e-a307-4112-9241-dd21c549e0c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dad5e2b-658f-4caf-a71c-f73ff56c166e', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:53:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-3c726d33-5491-442c-a512-c8d9611a2c82 req-4cc12344-bff6-43ee-9544-c75fc920b2b9 tempest-AttachVolumeTestJSON-903926484 None] attachment_update completed successfully.
Sep 20 16:53:37 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.558s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:37 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:37 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:37 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.556s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:37 devstack sudo[93325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52
Sep 20 16:53:37 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-1e1692ec-3d14-4137-9419-c1f821120a40-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-1e1692ec-3d14-4137-9419-c1f821120a40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-1e1692ec-3d14-4137-9419-c1f821120a40" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-1e1692ec-3d14-4137-9419-c1f821120a40" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Deleting offline snapshot 1e1692ec-3d14-4137-9419-c1f821120a40 of volume becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] snapshot_file for this snap is: volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7e8e5-4773-4e27-8d47-12c072f42146]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:38 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a.282b5511-a90a-4e16-a3dc-d09cf1731a52" returned: 0 in 0.579s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-282b5511-a90a-4e16-a3dc-d09cf1731a52" released by "_delete_snapshot" :: held 2.470s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" released by "delete_snapshot" :: held 2.515s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:38 devstack sudo[93329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40
Sep 20 16:53:38 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:38 devstack cinder-volume[85945]: WARNING cinder.quota [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1281459925 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1281459925, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['0621341a-160c-439a-ab05-7ae153b22352', 'af047691-dd63-46ff-8207-356427f5ee39', 'd583edd0-2468-432b-b03e-9fe8c496f227', '96c26139-b1a5-4e48-83da-3a58eaecba5c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-55f49280-f733-4de8-9537-1337f1793aad tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 8a8f74bd-048c-4de6-b42d-f3f42871fac5: deleted successfully
Sep 20 16:53:38 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40" returned: 0 in 0.636s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-becedf08-5758-4049-b21d-01b60d0f5536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d67af5-a1d3-419e-9dbc-ca4e996b22ad]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:39 devstack sudo[93336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536
Sep 20 16:53:39 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:39 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536" returned: 0 in 0.727s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:39 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40
Sep 20 16:53:39 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" acquired by "delete_volume" :: waited 0.051s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9a3233-e8d5-47f6-9d3c-f53fbc05ad86]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:40 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40" returned: 0 in 0.725s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:40 devstack sudo[93353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40
Sep 20 16:53:40 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:40 devstack sudo[93352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:40 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-6f80668a-2b0b-4431-872e-47a59b2b4361 req-517c1dca-1eca-49b6-bd94-3021de1c4b06 tempest-AttachVolumeTestJSON-903926484 None] Terminate volume connection completed successfully.
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-6f80668a-2b0b-4431-872e-47a59b2b4361 req-517c1dca-1eca-49b6-bd94-3021de1c4b06 tempest-AttachVolumeTestJSON-903926484 None] Deleting attachment 6052328e-11a8-4c57-8f6c-196f1e2a23d0. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:53:40 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536.1e1692ec-3d14-4137-9419-c1f821120a40" returned: 0 in 0.549s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-1e1692ec-3d14-4137-9419-c1f821120a40" released by "_delete_snapshot" :: held 2.821s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" released by "delete_snapshot" :: held 2.875s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['d9695a8c-baad-47e8-9bd3-c4ff8cb587ef', '78c70821-d376-4db7-8c1d-2a5897c556d3', '14d7f2de-6d06-47d0-be8b-cdf8f2957705', '9267dffa-4f73-4272-9cb6-60cee21bae2d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:41 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.932s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:41 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a
Sep 20 16:53:41 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Delete snapshot completed successfully.
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c92e284c-3119-4c74-8974-c197d5325c18 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-1e1692ec-3d14-4137-9419-c1f821120a40-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:41 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f256a542-c7d7-497f-b3dd-f43f39d14d9a" returned: 0 in 0.470s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-f256a542-c7d7-497f-b3dd-f43f39d14d9a" released by "delete_volume" :: held 1.549s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:41 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['05cd3bb9-9345-4f5a-aca1-8d666c53c2ab'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:42 devstack cinder-volume[85945]: WARNING cinder.db.api [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1281459925']
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['78a501cb-76b5-4c77-817f-f42ff54a0219', 'c291ec21-7f9f-4c02-a109-9cab16219c72', '47d50a5a-220c-4b1e-ae96-f3b594ada1cf', '6a1552f8-7ea6-40b6-a8a0-980436631aee'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:42 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:42 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (0133db12-3b95-4ce0-8716-c4e6063d9e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673582b-642a-4a33-bbc7-fac958e4f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673582b-642a-4a33-bbc7-fac958e4f17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-681022940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1782bc4-59a8-407b-9bb6-fdd703f8ea8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:42Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce3ea6a-ae22-4c2e-87c4-dc6b393e89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce3ea6a-ae22-4c2e-87c4-dc6b393e89b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb26225-0518-47aa-a928-db33aeff82ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb26225-0518-47aa-a928-db33aeff82ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1782bc4-59a8-407b-9bb6-fdd703f8ea8c', 'volume_name': 'volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f9084-4137-4fe1-8ac2-2d5db7e5af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f9084-4137-4fe1-8ac2-2d5db7e5af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627842d8-31e5-4b8a-99ea-dc6bf4df9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:42 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Volume b1782bc4-59a8-407b-9bb6-fdd703f8ea8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c', 'volume_size': 1}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-681022940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1782bc4-59a8-407b-9bb6-fdd703f8ea8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:42Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Creating volume b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:42 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:42 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c 1073741824
Sep 20 16:53:42 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-0e30d69c-b626-443d-a2c1-a6d7e2c8792d req-ec7503ce-2378-4f93-af42-2eb08db67bc6 tempest-AttachVolumeTestJSON-903926484 None] Terminate volume connection completed successfully.
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-0e30d69c-b626-443d-a2c1-a6d7e2c8792d req-ec7503ce-2378-4f93-af42-2eb08db67bc6 tempest-AttachVolumeTestJSON-903926484 None] Deleting attachment 4dad5e2b-658f-4caf-a71c-f73ff56c166e. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:53:42 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.561s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:42 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a49b654f-c5de-4810-aabc-bdf55d46a576 tempest-GroupSnapshotsTest-1935343413 None] Delete group completed successfully.
Sep 20 16:53:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-10b694ae-4b31-4d52-92e9-7d0fa537ab49 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-1663883802: creating
Sep 20 16:53:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-10b694ae-4b31-4d52-92e9-7d0fa537ab49 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-1663883802: created successfully
Sep 20 16:53:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-10b694ae-4b31-4d52-92e9-7d0fa537ab49 tempest-GroupSnapshotsTest-1935343413 None] Create group completed successfully.
Sep 20 16:53:44 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c 1073741824" returned: 0 in 1.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:44 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:53:44 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:45 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.832s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=96,cinder:SELECT=100,cinder:INSERT=27,cinder:DELETE=5 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627842d8-31e5-4b8a-99ea-dc6bf4df9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691ffe4b-b08d-4c12-a4c8-47b8d91bed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=117,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:53:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Volume volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c (b1782bc4-59a8-407b-9bb6-fdd703f8ea8c): created successfully
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691ffe4b-b08d-4c12-a4c8-47b8d91bed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (0133db12-3b95-4ce0-8716-c4e6063d9e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-744f24f6-e8e6-4fbc-b1c4-609e2312a17a tempest-VolumesSnapshotTestJSON-106406804 None] Created volume successfully.
Sep 20 16:53:45 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (12cf8aee-fb82-4da6-a1de-91b7948399f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2692a361-6de0-4448-b43f-c7478b90c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2692a361-6de0-4448-b43f-c7478b90c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820295116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0773c6-8ced-49f0-8e48-256215df2124,host='devstack@QuobyteHD#QuobyteHD',id=518ef13a-55a6-401e-947d-6adb9256b605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:46Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5de58d-4338-46ea-8af1-c4f81c28e3d0),volume_type_id=2b5de58d-4338-46ea-8af1-c4f81c28e3d0)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ade75af-7ae6-4b30-953c-5a190333e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ade75af-7ae6-4b30-953c-5a190333e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d1a83c-0bd7-4aa9-9860-69ec6a780eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d1a83c-0bd7-4aa9-9860-69ec6a780eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518ef13a-55a6-401e-947d-6adb9256b605', 'volume_name': 'volume-518ef13a-55a6-401e-947d-6adb9256b605', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d773e-8a69-4464-843b-12a83c116066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d773e-8a69-4464-843b-12a83c116066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b178b-0a0a-4f40-b332-d99e4b148239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:46 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Volume 518ef13a-55a6-401e-947d-6adb9256b605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518ef13a-55a6-401e-947d-6adb9256b605', 'volume_size': 1}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d0773c6-8ced-49f0-8e48-256215df2124,created_at=2026-09-20T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820295116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0773c6-8ced-49f0-8e48-256215df2124,host='devstack@QuobyteHD#QuobyteHD',id=518ef13a-55a6-401e-947d-6adb9256b605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:46Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5de58d-4338-46ea-8af1-c4f81c28e3d0),volume_type_id=2b5de58d-4338-46ea-8af1-c4f81c28e3d0)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Creating volume 518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:46 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:46 devstack sudo[93465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 1073741824
Sep 20 16:53:46 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:46 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 1073741824" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:46 devstack sudo[93472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605
Sep 20 16:53:46 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:47 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605" returned: 0 in 0.342s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.865s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b178b-0a0a-4f40-b332-d99e4b148239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518ef13a-55a6-401e-947d-6adb9256b605', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78061455-0f0d-44bb-beb3-7090c626a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Creating offline snapshot 02385240-7fc2-404d-87ad-d3f38a376088 of volume b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:53:47 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Volume volume-518ef13a-55a6-401e-947d-6adb9256b605 (518ef13a-55a6-401e-947d-6adb9256b605): created successfully
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78061455-0f0d-44bb-beb3-7090c626a599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (12cf8aee-fb82-4da6-a1de-91b7948399f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6bea36-06b7-4ae7-8bbc-d7fd5b6b1c4f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2ffde528-6969-408c-bac5-87efb499a6c9 tempest-GroupSnapshotsTest-1935343413 None] Created volume successfully.
Sep 20 16:53:47 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:53:47 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:47 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.659s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:48 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 1G
Sep 20 16:53:48 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-90034a71-7102-4138-9db6-26d6297fc34c req-8f3cdea4-0238-4f87-a496-e9fadb4f3ced tempest-ServerActionsTestOtherA-456319338 None] Terminate volume connection completed successfully.
Sep 20 16:53:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-90034a71-7102-4138-9db6-26d6297fc34c req-8f3cdea4-0238-4f87-a496-e9fadb4f3ced tempest-ServerActionsTestOtherA-456319338 None] Deleting attachment 277c965b-2f00-4ee7-8a63-31a613c104e2. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:53:48 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 1G" returned: 0 in 0.614s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:48 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:53:48 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:49 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.442s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:49 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 is being set with open permissions: ugo+rw
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:49 devstack sudo[93516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:53:49 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:49 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (22ea7513-2628-4449-9f9d-e451e5de47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeda555b-691e-4778-bea8-9ed006883ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeda555b-691e-4778-bea8-9ed006883ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900326829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0773c6-8ced-49f0-8e48-256215df2124,host='devstack@QuobyteHD#QuobyteHD',id=be2075fd-6c34-41e0-ab80-c141f91c8b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:49Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5de58d-4338-46ea-8af1-c4f81c28e3d0),volume_type_id=2b5de58d-4338-46ea-8af1-c4f81c28e3d0)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c02db8a-efee-4b5c-9609-e2f4559ef6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c02db8a-efee-4b5c-9609-e2f4559ef6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ac88f5-239e-4714-a6ee-a7f9427ccdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ac88f5-239e-4714-a6ee-a7f9427ccdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2075fd-6c34-41e0-ab80-c141f91c8b38', 'volume_name': 'volume-be2075fd-6c34-41e0-ab80-c141f91c8b38', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42501ba-5291-4663-9bd1-17ec2cd6662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42501ba-5291-4663-9bd1-17ec2cd6662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451886a0-91e0-447e-ba04-03f981ce6696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Volume be2075fd-6c34-41e0-ab80-c141f91c8b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2075fd-6c34-41e0-ab80-c141f91c8b38', 'volume_size': 1}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:49 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info
Sep 20 16:53:49 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:49 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info" returned: 0 in 0.296s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:49 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info is being set with open permissions: ugo+rw
Sep 20 16:53:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:49 devstack sudo[93525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info
Sep 20 16:53:49 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-deb93e9e-a307-4112-9241-dd21c549e0c7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-deb93e9e-a307-4112-9241-dd21c549e0c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-quobyte-deb93e9e-a307-4112-9241-dd21c549e0c7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-deb93e9e-a307-4112-9241-dd21c549e0c7" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:50 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.info" returned: 0 in 0.374s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[75087878-a701-45af-a5e2-f054e01ab45e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d0773c6-8ced-49f0-8e48-256215df2124,created_at=2026-09-20T14:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900326829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0773c6-8ced-49f0-8e48-256215df2124,host='devstack@QuobyteHD#QuobyteHD',id=be2075fd-6c34-41e0-ab80-c141f91c8b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:49Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5de58d-4338-46ea-8af1-c4f81c28e3d0),volume_type_id=2b5de58d-4338-46ea-8af1-c4f81c28e3d0)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Creating volume be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:50 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:50 devstack sudo[93535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 1073741824
Sep 20 16:53:50 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-312946a2-c4ac-4ae4-a81d-b702bee376c0 tempest-VolumesSnapshotTestJSON-106406804 None] Create snapshot completed successfully
Sep 20 16:53:50 devstack sudo[93536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7
Sep 20 16:53:50 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:50 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:50 devstack sudo[93547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7
Sep 20 16:53:50 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:50 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 1073741824" returned: 0 in 0.483s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:50 devstack sudo[93549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38
Sep 20 16:53:50 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:50 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-deb93e9e-a307-4112-9241-dd21c549e0c7" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-deb93e9e-a307-4112-9241-dd21c549e0c7" released by "delete_volume" :: held 0.764s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Created reservations ['3ed42bf8-e693-475e-8713-bffed31f7c8b', 'e38b3474-7778-4fa6-b5a7-004d238e236d', 'c4ad14bb-aff5-4ec6-b728-170316a4b3d8', 'd6bb50c7-384e-42f3-b313-14ae81237fb9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:51 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38" returned: 0 in 0.318s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.030s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:51 devstack sudo[93553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:51 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451886a0-91e0-447e-ba04-03f981ce6696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2075fd-6c34-41e0-ab80-c141f91c8b38', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03cd597-0096-4eeb-b46e-de5625e30d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b551b7-8849-474c-b716-d8c5cbc26fb7]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Volume volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 (be2075fd-6c34-41e0-ab80-c141f91c8b38): created successfully
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03cd597-0096-4eeb-b46e-de5625e30d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (22ea7513-2628-4449-9f9d-e451e5de47d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:53:51 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5948959d-d04f-4f92-ad3c-16216852593e tempest-GroupSnapshotsTest-1935343413 None] Created volume successfully.
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (04636146-fc9e-40b4-acb2-bd3d146d0dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ec4acc-681f-46c1-ac67-0d83ef096e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-e42178e5-209b-40cc-aa03-8ed4438e882e-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:51 devstack sudo[93555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:51 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ec4acc-681f-46c1-ac67-0d83ef096e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-374565290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6db669-8fb1-4a63-89d4-145edd50cf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:53:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=02385240-7fc2-404d-87ad-d3f38a376088,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:53:51Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1ca741-d08b-4322-a74f-6eabf4a37f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1ca741-d08b-4322-a74f-6eabf4a37f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8498e8b-4750-4e9e-bed4-602d25a1f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8498e8b-4750-4e9e-bed4-602d25a1f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc6db669-8fb1-4a63-89d4-145edd50cf9b', 'volume_name': 'volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b', 'volume_size': 2, 'snapshot_id': '02385240-7fc2-404d-87ad-d3f38a376088'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1fb14a-04f6-4a7c-b6cd-af1c651f07a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1fb14a-04f6-4a7c-b6cd-af1c651f07a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bf80cd-6053-41d5-90be-143242e13a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:53:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Volume bc6db669-8fb1-4a63-89d4-145edd50cf9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b', 'volume_size': 2, 'snapshot_id': '02385240-7fc2-404d-87ad-d3f38a376088'}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-e42178e5-209b-40cc-aa03-8ed4438e882e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:51 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.324s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:51 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Deleted volume successfully.
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-quobyte-e42178e5-209b-40cc-aa03-8ed4438e882e" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a4e9d764-a225-4fd5-be8a-740416387093 tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-deb93e9e-a307-4112-9241-dd21c549e0c7-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-e42178e5-209b-40cc-aa03-8ed4438e882e" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca53b2-6c33-4e28-8ab9-59f1b9173ab3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:51 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:51 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e
Sep 20 16:53:51 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:51 devstack sudo[93562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:53:51 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:51 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:51 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e
Sep 20 16:53:51 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:51 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 1 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.870s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.594s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088-bc6db669-8fb1-4a63-89d4-145edd50cf9b" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088-bc6db669-8fb1-4a63-89d4-145edd50cf9b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Creating volume bc6db669-8fb1-4a63-89d4-145edd50cf9b from snapshot 02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] snapshot: 02385240-7fc2-404d-87ad-d3f38a376088, volume: bc6db669-8fb1-4a63-89d4-145edd50cf9b,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-ac48d28d-f5dc-43af-bccd-930c9c379509', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '798441cd-1a08-4574-8026-0b9580117240', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2eb18-1a67-437f-8239-71ace53d5668]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:52 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e42178e5-209b-40cc-aa03-8ed4438e882e" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-e42178e5-209b-40cc-aa03-8ed4438e882e" released by "delete_volume" :: held 0.713s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-90034a71-7102-4138-9db6-26d6297fc34c req-df66f0ec-7359-4e49-9686-a7690d98a9b0 tempest-ServerActionsTestOtherA-456319338 None] attachment_update completed successfully.
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Created reservations ['837bb060-80a9-43e5-846c-32ef105ac4dd', '83541812-e31d-48f8-837c-9d1ebb46cb1d', '4bc2b0aa-13bb-44ef-9f2b-56b7c1cb4192', 'a32e2f53-7828-4356-8567-cc2c992270fc'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:52 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:53:52 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:52 devstack sudo[93575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:52 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ab4fee35-3c33-43b1-b664-621444a20341 tempest-GroupSnapshotsTest-1935343413 None] Update group completed successfully.
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-c3e205a9-2155-4afa-baf1-7204bde1dd1b-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:52 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.375s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-c3e205a9-2155-4afa-baf1-7204bde1dd1b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Deleted volume successfully.
Sep 20 16:53:52 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.651s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5fb985b8-34c6-4179-8fb6-0b217b7a47ff tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-e42178e5-209b-40cc-aa03-8ed4438e882e-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21d726-0f5d-4142-bd10-a98728e6d920]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "cinder-quobyte-c3e205a9-2155-4afa-baf1-7204bde1dd1b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-c3e205a9-2155-4afa-baf1-7204bde1dd1b" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a33c9b-35e7-4172-85ee-8e3237c427ca]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:53:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:52 devstack sudo[93676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:53:52 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:53 devstack sudo[93679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b
Sep 20 16:53:53 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:53 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.565s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:53 devstack sudo[94027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b
Sep 20 16:53:53 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:53 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b" returned: 0 in 0.614s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:53 devstack sudo[94031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b
Sep 20 16:53:53 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-16a23e2d-2489-49c4-ad00-ecbf12dff844 tempest-GroupSnapshotsTest-1935343413 None] Update group completed successfully.
Sep 20 16:53:53 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c3e205a9-2155-4afa-baf1-7204bde1dd1b" returned: 0 in 0.495s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-quobyte-c3e205a9-2155-4afa-baf1-7204bde1dd1b" released by "delete_volume" :: held 1.184s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Created reservations ['5c598343-7f73-4480-aaa6-0f841443497d', '025a4924-26b5-43b8-978b-98c1058b17f5', '596f26d4-0c50-494f-9721-6b2d1e14c95e', '34aaf872-c637-474c-9a2f-15d5037aa63b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:54 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:54 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:54 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.588s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Deleted volume successfully.
Sep 20 16:53:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-10a56c73-1fc8-4937-a775-3342cc762daf tempest-AttachVolumeTestJSON-903926484 None] Lock "cinder-c3e205a9-2155-4afa-baf1-7204bde1dd1b-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:53:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-120c5bc6-daa3-4fed-b8b8-11364022eb05 tempest-GroupSnapshotsTest-1935343413 None] Update group completed successfully.
Sep 20 16:53:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-de7a6728-8b02-47e9-ba64-0786895803ff tempest-GroupSnapshotsTest-1935343413 None] Update group completed successfully.
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:53:58 devstack sudo[94102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:53:58 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:53:58 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:53:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:53:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] GroupSnapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: creating.
Sep 20 16:53:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Group snapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: creating. {{(pid=85945) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 20 16:53:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-08ba2c36-2ecd-49b3-ab78-58fd98265c27 tempest-ServerActionsTestOtherA-456319338 None] Terminate volume connection completed successfully.
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-08ba2c36-2ecd-49b3-ab78-58fd98265c27 tempest-ServerActionsTestOtherA-456319338 None] Deleting attachment 798441cd-1a08-4574-8026-0b9580117240. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "cinder-ac48d28d-f5dc-43af-bccd-930c9c379509-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-ac48d28d-f5dc-43af-bccd-930c9c379509-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "cinder-quobyte-ac48d28d-f5dc-43af-bccd-930c9c379509" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-quobyte-ac48d28d-f5dc-43af-bccd-930c9c379509" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e02fb-9a48-4e33-805b-953d4670c882]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:00 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:54:00 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:01 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.552s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:01 devstack sudo[94120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:54:01 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:01 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 1 in 0.745s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:54:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "cinder-a2da9941-f64d-4b07-a1e4-d15ab57a08e0-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:02 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509
Sep 20 16:54:02 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-a2da9941-f64d-4b07-a1e4-d15ab57a08e0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "cinder-quobyte-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-quobyte-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" acquired by "delete_volume" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d845ad18-9eb4-433d-a722-37ebbcd6a4b8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:02 devstack sudo[94127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0
Sep 20 16:54:02 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:02 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ac48d28d-f5dc-43af-bccd-930c9c379509" returned: 0 in 0.650s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-quobyte-ac48d28d-f5dc-43af-bccd-930c9c379509" released by "delete_volume" :: held 2.109s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.quota [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Created reservations ['ae5caf6e-8e0e-4761-bcc5-20328fe602c3', '99cfb2ca-fc5b-4190-a8ff-af94b4244e42', 'cdebc507-b7d9-4eda-a997-7b75f1b39b83', '42b6c91a-91c1-4256-9168-2aeb4500477f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:02 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b" returned: 0 in 9.462s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4874bd7d-435d-4b6a-96c8-c20f70e5f4e4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:02 devstack sudo[94133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:02 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:03 devstack sudo[94130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:54:03 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:03 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" returned: 0 in 0.781s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:03 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0
Sep 20 16:54:03 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:03 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.manager [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Deleted volume successfully.
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-4f506816-d1d6-40ff-9aa9-d0b7c53a179d req-d5775f06-33a5-488f-b6e1-01ec1b807971 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-ac48d28d-f5dc-43af-bccd-930c9c379509-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:03 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-quobyte-a2da9941-f64d-4b07-a1e4-d15ab57a08e0" released by "delete_volume" :: held 1.230s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Created reservations ['7ba75b0c-47a9-4dab-b7aa-a6cd0d3b18a2', '92e099f0-150c-4925-badd-e752313fffd1', '23bfa619-683b-4113-a4b1-8b6897b9551a', '62adc767-d7ad-491d-b933-3d25e4ef2f39'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:03 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.697s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:54:03 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Converted 1024.00 MB image at 108.21 MB/s
Sep 20 16:54:03 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b is being set with open permissions: ugo+rw
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:03 devstack sudo[94146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:03 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:03 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b
Sep 20 16:54:03 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:03 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Deleted volume successfully.
Sep 20 16:54:03 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6913f410-51ab-4866-a3b5-f2a1b2a2a384 tempest-ServerActionsTestOtherA-456319338 None] Lock "cinder-a2da9941-f64d-4b07-a1e4-d15ab57a08e0-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" released by "_copy_volume_from_snapshot" :: held 11.838s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088-bc6db669-8fb1-4a63-89d4-145edd50cf9b" released by "_create_volume_from_snapshot" :: held 11.884s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.909s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.812s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Creating offline snapshot 6c0322e9-35d7-4267-865a-78ff4aa1ff45 of volume 518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bf80cd-6053-41d5-90be-143242e13a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b', 'volume_size': 2, 'snapshot_id': '02385240-7fc2-404d-87ad-d3f38a376088'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f9fe5-8c3b-43f2-822f-ed9dadff5a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2280e3f-76e6-4a40-af78-aae96c6bd489]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:04 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Volume volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b (bc6db669-8fb1-4a63-89d4-145edd50cf9b): created successfully
Sep 20 16:54:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f9fe5-8c3b-43f2-822f-ed9dadff5a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (04636146-fc9e-40b4-acb2-bd3d146d0dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6a8da16d-bc99-4277-8b0c-2fec3f8422fc tempest-VolumesSnapshotTestJSON-106406804 None] Created volume successfully.
Sep 20 16:54:04 devstack sudo[94152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605
Sep 20 16:54:04 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:04 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:04 devstack sudo[94157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 1G
Sep 20 16:54:04 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:05 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 1G" returned: 0 in 0.679s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ef13a-55a6-401e-947d-6adb9256b605 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:05 devstack sudo[94181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ef13a-55a6-401e-947d-6adb9256b605 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45
Sep 20 16:54:05 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-bc6db669-8fb1-4a63-89d4-145edd50cf9b-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-bc6db669-8fb1-4a63-89d4-145edd50cf9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48436b9-1012-45d6-9525-43730361434e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:05 devstack sudo[94187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b
Sep 20 16:54:05 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:05 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ef13a-55a6-401e-947d-6adb9256b605 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45" returned: 0 in 0.470s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:05 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:05 devstack sudo[94193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45
Sep 20 16:54:05 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:05 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b" returned: 0 in 0.533s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:05 devstack sudo[94198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b
Sep 20 16:54:05 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:06 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45" returned: 0 in 0.473s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:06 devstack sudo[94203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info
Sep 20 16:54:06 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:06 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bc6db669-8fb1-4a63-89d4-145edd50cf9b" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-bc6db669-8fb1-4a63-89d4-145edd50cf9b" released by "delete_volume" :: held 1.044s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['f1b3a8b4-5aa7-4f71-b27e-1eda0dbeb1eb', '0fbf0c94-2be9-42c9-8773-4d7058b0a122', '1ce70b25-c717-47c8-ab77-d76725552a02', '66e32ff5-873b-49bb-af19-cf25abca0bce'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:06 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info" returned: 0 in 0.322s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:06 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:06 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info
Sep 20 16:54:06 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:06 devstack sudo[94209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:06 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:06 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.info" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:06 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Deleted volume successfully.
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Creating offline snapshot 73bea35f-5744-4050-9422-e680bb9ed3cc of volume be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fee8a52d-c397-4878-bdf4-35233cbc52ba tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-bc6db669-8fb1-4a63-89d4-145edd50cf9b-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7ab821-0a2f-48b5-8437-7764cf30c995]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:06 devstack sudo[94213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38
Sep 20 16:54:06 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:07 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:07 devstack sudo[94218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc 1G
Sep 20 16:54:07 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-02385240-7fc2-404d-87ad-d3f38a376088-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-02385240-7fc2-404d-87ad-d3f38a376088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Deleting offline snapshot 02385240-7fc2-404d-87ad-d3f38a376088 of volume b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] snapshot_file for this snap is: volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88c72a3-7fb5-46ac-b2f7-ad8c16e8bd57]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (f35d8398-2ef3-4acf-aec8-53d2f326fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:07 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a241a-8406-4148-ad98-b4276768d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc 1G" returned: 0 in 0.676s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:07 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:54:07 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a241a-8406-4148-ad98-b4276768d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510354438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d35bb37-233f-4d7c-827c-02b784caa43d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:08Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57927d41-7561-4b8c-b015-f5b76d912ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:07 devstack sudo[94226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc
Sep 20 16:54:07 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57927d41-7561-4b8c-b015-f5b76d912ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbd126e-bb60-45df-8712-8faf7467a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbd126e-bb60-45df-8712-8faf7467a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d35bb37-233f-4d7c-827c-02b784caa43d', 'volume_name': 'volume-0d35bb37-233f-4d7c-827c-02b784caa43d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75b580c-6490-4fbe-8710-3fdec93f1a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75b580c-6490-4fbe-8710-3fdec93f1a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392a6feb-2d4b-4990-979e-b06897f0f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:07 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Volume 0d35bb37-233f-4d7c-827c-02b784caa43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d35bb37-233f-4d7c-827c-02b784caa43d', 'volume_size': 1}
Sep 20 16:54:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:08 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.471s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[369250a1-c482-4966-a20b-e70e3b2bbfb6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:08 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:08 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:08 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc
Sep 20 16:54:08 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:08 devstack sudo[94236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:54:08 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:08 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc" returned: 0 in 0.290s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:08 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info
Sep 20 16:54:08 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:08 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:08 devstack sudo[94246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:54:08 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:08 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:08 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:08 devstack sudo[94251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info
Sep 20 16:54:08 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:09 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:09 devstack sudo[94254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088
Sep 20 16:54:09 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:09 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.info" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510354438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d35bb37-233f-4d7c-827c-02b784caa43d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:08Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Creating volume 0d35bb37-233f-4d7c-827c-02b784caa43d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:09 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:09 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d 1073741824
Sep 20 16:54:09 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:09 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c.02385240-7fc2-404d-87ad-d3f38a376088" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-02385240-7fc2-404d-87ad-d3f38a376088" released by "_delete_snapshot" :: held 1.798s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" released by "delete_snapshot" :: held 1.868s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-298841e0-bd99-4c1c-beb5-eefe5a733c9a tempest-GroupSnapshotsTest-1935343413 None] group_snapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: created successfully
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['808266d4-2f47-464e-b357-4d6bbc9fe8ab', '27fe7a69-7681-4726-bba0-73a72684c433', '6ecdcc94-e9ca-4842-bb0e-bcc5628fcc95', '48bb221e-fe00-4f7e-bae3-106ba50994f5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Delete snapshot completed successfully.
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-003b6c67-ea9e-438d-b0d0-002c7fbeb9c3 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-02385240-7fc2-404d-87ad-d3f38a376088-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:09 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d 1073741824" returned: 0 in 0.698s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: deleting
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846cf2b-bc0e-4a05-82d5-b5571a8f96de]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: deleting {{(pid=85945) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 20 16:54:10 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d
Sep 20 16:54:10 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-6c0322e9-35d7-4267-865a-78ff4aa1ff45" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-6c0322e9-35d7-4267-865a-78ff4aa1ff45" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Deleting offline snapshot 6c0322e9-35d7-4267-865a-78ff4aa1ff45 of volume 518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] snapshot_file for this snap is: volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:54:10 devstack sudo[94265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:54:10 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3aa3d-c3a5-405a-b8d3-1176d0b3e1ae]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:10 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45
Sep 20 16:54:10 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:10 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392a6feb-2d4b-4990-979e-b06897f0f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d35bb37-233f-4d7c-827c-02b784caa43d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f3b0e3-de09-4d32-a420-c0d54e3cd199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:10 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Volume volume-0d35bb37-233f-4d7c-827c-02b784caa43d (0d35bb37-233f-4d7c-827c-02b784caa43d): created successfully
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f3b0e3-de09-4d32-a420-c0d54e3cd199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (f35d8398-2ef3-4acf-aec8-53d2f326fa93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3f9691ed-d7e9-4735-9ab1-c1121f5068d2 tempest-VolumesTestJSON-382019945 None] Created volume successfully.
Sep 20 16:54:10 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.589s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:10 devstack sudo[94279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c
Sep 20 16:54:10 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:10 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45" returned: 0 in 0.471s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-518ef13a-55a6-401e-947d-6adb9256b605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[26901453-c5aa-4149-be0e-47da93652546]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:10 devstack sudo[94282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605
Sep 20 16:54:10 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:11 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" returned: 0 in 0.423s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c" released by "delete_volume" :: held 1.107s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['d3aea878-1d46-480c-8e1e-8f64db596d12', 'd2628a7d-0fe0-4273-baa6-55f4de0e19b6', '2dfacb35-fb09-4a07-a8a6-9b51ae245c27', 'eeb25485-114d-4e7a-851a-47cf47d5fe82'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:11 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605" returned: 0 in 0.529s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:11 devstack sudo[94288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:11 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:11 devstack sudo[94289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45
Sep 20 16:54:11 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:11 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.381s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Deleted volume successfully.
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dfbe95e1-ea87-4aa6-b91a-31d4ad3fe415 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-b1782bc4-59a8-407b-9bb6-fdd703f8ea8c-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:11 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45" returned: 0 in 0.471s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:11 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45
Sep 20 16:54:11 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (b98b26e4-2f5e-4103-8ad0-83d983050140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c77f91c-09ec-494b-ad5d-b5b0f331e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c77f91c-09ec-494b-ad5d-b5b0f331e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676281481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb8a64-816a-4970-a8af-ca95e8ce89da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:12Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2649ca33-d4bd-4fa3-ae94-a5d0ef9aa76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2649ca33-d4bd-4fa3-ae94-a5d0ef9aa76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dba748-9349-4ae2-9414-848c0c255146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dba748-9349-4ae2-9414-848c0c255146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fb8a64-816a-4970-a8af-ca95e8ce89da', 'volume_name': 'volume-39fb8a64-816a-4970-a8af-ca95e8ce89da', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa939da-580c-4856-b813-c317c25e8951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa939da-580c-4856-b813-c317c25e8951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26760e5f-1973-47c4-aee9-b218ad87a194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Volume 39fb8a64-816a-4970-a8af-ca95e8ce89da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fb8a64-816a-4970-a8af-ca95e8ce89da', 'volume_size': 1}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676281481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb8a64-816a-4970-a8af-ca95e8ce89da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:12Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Creating volume 39fb8a64-816a-4970-a8af-ca95e8ce89da {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:11 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:11 devstack sudo[94298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da 1073741824
Sep 20 16:54:11 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:12 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605.6c0322e9-35d7-4267-865a-78ff4aa1ff45" returned: 0 in 0.321s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-6c0322e9-35d7-4267-865a-78ff4aa1ff45" released by "_delete_snapshot" :: held 1.953s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" released by "delete_snapshot" :: held 1.986s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-73bea35f-5744-4050-9422-e680bb9ed3cc" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-73bea35f-5744-4050-9422-e680bb9ed3cc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Deleting offline snapshot 73bea35f-5744-4050-9422-e680bb9ed3cc of volume be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] snapshot_file for this snap is: volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2a074-39b6-47a7-bc9e-d0dd004b8030]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:12 devstack sudo[94304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc
Sep 20 16:54:12 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:12 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da 1073741824" returned: 0 in 0.544s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:12 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da
Sep 20 16:54:12 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:12 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc" returned: 0 in 0.505s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2075fd-6c34-41e0-ab80-c141f91c8b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:12 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26760e5f-1973-47c4-aee9-b218ad87a194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fb8a64-816a-4970-a8af-ca95e8ce89da', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59445f97-fb67-4611-a430-204bcf3b05a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e61fd45-a72b-4c40-94cf-e80393e9a896]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Volume volume-39fb8a64-816a-4970-a8af-ca95e8ce89da (39fb8a64-816a-4970-a8af-ca95e8ce89da): created successfully
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59445f97-fb67-4611-a430-204bcf3b05a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (b98b26e4-2f5e-4103-8ad0-83d983050140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (593b7e84-adca-47df-8911-25ffb9e5eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e8be1f-1a3e-42dc-960f-1c66207f65e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d8ae389d-9765-442d-9683-9165eb370618 tempest-VolumesTestJSON-382019945 None] Created volume successfully.
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e8be1f-1a3e-42dc-960f-1c66207f65e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-466457350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0813a82-af97-4af4-8e34-31666ea026fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:13Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327d2a54-b5d9-408a-850d-b0ca80b15816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack sudo[94312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38
Sep 20 16:54:12 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327d2a54-b5d9-408a-850d-b0ca80b15816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f85ea9-1d1a-408c-a496-a5667e92f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f85ea9-1d1a-408c-a496-a5667e92f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0813a82-af97-4af4-8e34-31666ea026fd', 'volume_name': 'volume-f0813a82-af97-4af4-8e34-31666ea026fd', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010af5d0-acbc-4464-a397-d07e3bd567a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010af5d0-acbc-4464-a397-d07e3bd567a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2657a65-7b4e-4077-8af4-b6b9c3e6e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Volume f0813a82-af97-4af4-8e34-31666ea026fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0813a82-af97-4af4-8e34-31666ea026fd', 'volume_size': 1}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-466457350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0813a82-af97-4af4-8e34-31666ea026fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:13Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Creating volume f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:12 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:13 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd 1073741824
Sep 20 16:54:13 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:13 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38" returned: 0 in 0.513s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:13 devstack sudo[94323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc
Sep 20 16:54:13 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:13 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd 1073741824" returned: 0 in 0.584s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:13 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:13 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:13 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc" returned: 0 in 0.511s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:13 devstack sudo[94331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc
Sep 20 16:54:13 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:13 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2657a65-7b4e-4077-8af4-b6b9c3e6e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0813a82-af97-4af4-8e34-31666ea026fd', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad79b0ca-fa27-4550-a628-42612f699531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Volume volume-f0813a82-af97-4af4-8e34-31666ea026fd (f0813a82-af97-4af4-8e34-31666ea026fd): created successfully
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad79b0ca-fa27-4550-a628-42612f699531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (593b7e84-adca-47df-8911-25ffb9e5eb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-14d63708-147e-49d9-9ec1-538105eeba8e tempest-VolumesSnapshotTestJSON-106406804 None] Created volume successfully.
Sep 20 16:54:14 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38.73bea35f-5744-4050-9422-e680bb9ed3cc" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-73bea35f-5744-4050-9422-e680bb9ed3cc" released by "_delete_snapshot" :: held 2.080s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" released by "delete_snapshot" :: held 2.106s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:14 devstack cinder-volume[85945]: WARNING cinder.quota [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-867513295 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-867513295, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:14 devstack cinder-volume[85945]: WARNING cinder.quota [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-867513295 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-867513295, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['da8da4ad-b769-4c61-8d18-f067fd0e4cc0', '9aa3322b-d99b-4a6e-8a30-b6df4f34e470', 'e593569c-8ced-49b6-9a99-c1ef38fdcb24', '7209800e-4782-4db1-a24f-288a12d29636'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['6755a6f9-8c2b-4f73-8020-1cb9da9e399c', 'da68a0a2-7289-4e52-86de-1c2c34b8394a', 'bb4bfe7d-e3a8-4a11-83fe-2cbd7baba7b4', 'c3804767-a548-440b-89f6-851693815a65'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (4729dbe0-a1e0-442b-b625-cc9eeff0d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be14536-120e-49d1-aca4-fc27ac1ff8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be14536-120e-49d1-aca4-fc27ac1ff8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1051450902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c99f83-c3b5-4c75-94c2-f6dc7e7f0042,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:15Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9e45f9-da4b-4c69-b42b-f5ec0f798acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9e45f9-da4b-4c69-b42b-f5ec0f798acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82526f7b-84c3-44c0-843f-de5ca461bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82526f7b-84c3-44c0-843f-de5ca461bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c99f83-c3b5-4c75-94c2-f6dc7e7f0042', 'volume_name': 'volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d995ce96-1049-483b-a9cb-53bbf1efd971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d995ce96-1049-483b-a9cb-53bbf1efd971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef8cd2a-0393-452e-bd91-aeab61f23c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Volume 49c99f83-c3b5-4c75-94c2-f6dc7e7f0042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042', 'volume_size': 1}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1051450902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c99f83-c3b5-4c75-94c2-f6dc7e7f0042,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1474c882f224579beb99a9fcc81f54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:15Z,use_quota=True,user_id='7b1943c0f8b149cda583b8c7fe1df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Creating volume 49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:14 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:14 devstack sudo[94336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 1073741824
Sep 20 16:54:14 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-02ca3196-3673-450a-968e-8010f3e650f7 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot a96ea24b-08f5-47f9-a155-6332362ff4a0: deleted successfully
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:15 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 1073741824" returned: 0 in 0.547s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:15 devstack sudo[94342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042
Sep 20 16:54:15 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:15 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" returned: 0 in 0.247s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef8cd2a-0393-452e-bd91-aeab61f23c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2963dac2-6f05-4fa0-b71c-ff995b11c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Creating offline snapshot c99c4c89-deef-42d5-bcf7-505e21aa2bfa of volume f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:54:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Volume volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 (49c99f83-c3b5-4c75-94c2-f6dc7e7f0042): created successfully
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2963dac2-6f05-4fa0-b71c-ff995b11c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Flow 'volume_create_manager' (4729dbe0-a1e0-442b-b625-cc9eeff0d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[982455ef-b487-4aa9-a4db-86d389f4912d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b128c97d-4104-4b2f-8522-819085b5fe7f tempest-VolumesTestJSON-382019945 None] Created volume successfully.
Sep 20 16:54:15 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:15 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:16 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:16 devstack sudo[94350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa 1G
Sep 20 16:54:16 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9208701-3949-4814-998e-1b900e1dea31]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:16 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605
Sep 20 16:54:16 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:16 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa 1G" returned: 0 in 0.491s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0813a82-af97-4af4-8e34-31666ea026fd -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:16 devstack sudo[94358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0813a82-af97-4af4-8e34-31666ea026fd -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:16 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:16 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605" returned: 0 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:16 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0813a82-af97-4af4-8e34-31666ea026fd -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:16 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa is being set with open permissions: ugo+rw
Sep 20 16:54:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:16 devstack sudo[94366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605
Sep 20 16:54:16 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:16 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:16 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:17 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-518ef13a-55a6-401e-947d-6adb9256b605" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:17 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-518ef13a-55a6-401e-947d-6adb9256b605" released by "delete_volume" :: held 0.929s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b93de3-8915-4f37-a503-786a5f348e0f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:17 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info
Sep 20 16:54:17 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:17 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38
Sep 20 16:54:17 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:17 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info" returned: 0 in 0.447s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:17 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info is being set with open permissions: ugo+rw
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:17 devstack sudo[94380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info
Sep 20 16:54:17 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:17 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38" returned: 0 in 0.482s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:17 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38
Sep 20 16:54:17 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:18 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.info" returned: 0 in 0.347s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "cinder-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:18 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b57d9023-edfc-4576-888a-8486519c7c03 tempest-VolumesSnapshotTestJSON-106406804 None] Create snapshot completed successfully
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be2075fd-6c34-41e0-ab80-c141f91c8b38" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-be2075fd-6c34-41e0-ab80-c141f91c8b38" released by "delete_volume" :: held 1.033s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-quobyte-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" acquired by "delete_volume" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1438f6d3-9108-4f80-a335-d5bd7302e943]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['0bed7fe6-839a-40ab-84a6-8cd1a733e662'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:18 devstack cinder-volume[85945]: WARNING cinder.quota [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-867513295 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-867513295, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['de37e5f4-f904-454a-89e1-d69ebfaaefd8', '2cad03d0-bacc-4fa1-b101-ef65e1b02060', 'b321eeda-0614-45e5-a1cd-a108c0a4e754', 'b0b681f0-0acd-4f8e-82c3-bbfb7fe87afd'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:18 devstack sudo[94387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042
Sep 20 16:54:18 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['d4c54cfb-9ab0-4fde-9c09-40195d4a3b86', '6499a6aa-3405-44ce-b0e8-3e3ebab5a48d', '77a159e0-92ea-495a-a7a7-a36404cb8226', '69c6cbb5-ec4c-45f2-9b16-a45a06ff0693'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:18 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" returned: 0 in 0.475s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:18 devstack sudo[94393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:18 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:18 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:18 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:19 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" returned: 0 in 0.326s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042" released by "delete_volume" :: held 0.889s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:19 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.374s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-551c9111-8a28-4964-8321-136f430f8fe8 tempest-GroupSnapshotsTest-1935343413 None] Delete group completed successfully.
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (802ea6e8-c33f-488a-9e7b-e246909aae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80116ee7-be81-40ba-8b98-90989c0ec407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80116ee7-be81-40ba-8b98-90989c0ec407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1033452551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78853f14-df77-4651-b027-6c0b3fa89a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f67162c6a464c5899c12694be248dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c99c4c89-deef-42d5-bcf7-505e21aa2bfa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:19Z,use_quota=True,user_id='3494a6d95d544c5cbb40457b70ebfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775ca66-de4f-42e7-8f4a-0aab6dd6c492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775ca66-de4f-42e7-8f4a-0aab6dd6c492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8485267-4081-43f9-91ba-836ae7e89ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8485267-4081-43f9-91ba-836ae7e89ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78853f14-df77-4651-b027-6c0b3fa89a0c', 'volume_name': 'volume-78853f14-df77-4651-b027-6c0b3fa89a0c', 'volume_size': 1, 'snapshot_id': 'c99c4c89-deef-42d5-bcf7-505e21aa2bfa'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4c0272-e304-4cec-9d01-f0e15f0e1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4c0272-e304-4cec-9d01-f0e15f0e1a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93587073-dc0e-416e-9627-a008d10fb8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Volume 78853f14-df77-4651-b027-6c0b3fa89a0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78853f14-df77-4651-b027-6c0b3fa89a0c', 'volume_size': 1, 'snapshot_id': 'c99c4c89-deef-42d5-bcf7-505e21aa2bfa'}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-78853f14-df77-4651-b027-6c0b3fa89a0c" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Created reservations ['01cc3ff8-bf21-4726-8db2-8297437cc651', '9cc84208-6952-4b4a-9d7b-a5d1a08797c5', 'b0324c62-ce80-497b-8e2b-d46daca34f42', '4fc6b3ee-ddde-4b77-8123-34b385dcf1ac'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-78853f14-df77-4651-b027-6c0b3fa89a0c" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Creating volume 78853f14-df77-4651-b027-6c0b3fa89a0c from snapshot c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] snapshot: c99c4c89-deef-42d5-bcf7-505e21aa2bfa, volume: 78853f14-df77-4651-b027-6c0b3fa89a0c,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccbc8b1-b07f-4a41-9786-0e8737e8aad3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:19 devstack sudo[94401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:19 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:19 devstack sudo[94400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:19 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:19 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Deleted volume successfully.
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d65873c1-6b0f-4108-842e-3e1ee9e211c6 tempest-VolumesTestJSON-382019945 None] Lock "cinder-49c99f83-c3b5-4c75-94c2-f6dc7e7f0042-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:19 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.434s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0813a82-af97-4af4-8e34-31666ea026fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8e476-3fb3-411c-8672-0fd10f1bffba]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:20 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:20 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-39fb8a64-816a-4970-a8af-ca95e8ce89da-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "cinder-39fb8a64-816a-4970-a8af-ca95e8ce89da-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:20 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.523s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ac653c7b-530c-4c7c-909c-42a1ddb54f81 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-199957770: creating
Sep 20 16:54:20 devstack sudo[94413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c
Sep 20 16:54:20 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-quobyte-39fb8a64-816a-4970-a8af-ca95e8ce89da" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ac653c7b-530c-4c7c-909c-42a1ddb54f81 tempest-GroupSnapshotsTest-1935343413 None] Group tempest-GroupSnapshotsTest-Group-199957770: created successfully
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-39fb8a64-816a-4970-a8af-ca95e8ce89da" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ac653c7b-530c-4c7c-909c-42a1ddb54f81 tempest-GroupSnapshotsTest-1935343413 None] Create group completed successfully.
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad560b-9595-4581-b846-98f7b7373c8c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:20 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da
Sep 20 16:54:20 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:21 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:21 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da
Sep 20 16:54:21 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:21 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-39fb8a64-816a-4970-a8af-ca95e8ce89da" returned: 0 in 0.635s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-39fb8a64-816a-4970-a8af-ca95e8ce89da" released by "delete_volume" :: held 1.140s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:21 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Created reservations ['d2ec4811-8a5e-41a6-8484-d326fe1c38e4', '7b96e673-9e9a-424b-bae4-0151942d9b16', '98cebe78-9f68-429b-9f3a-c05bdc61b6ae', '6b44a14b-a705-4875-9f21-c674bfb2750f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:22 devstack sudo[94433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:22 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:22 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.650s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Deleted volume successfully.
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75041790-8663-43ed-9942-9886bed6ebc7 tempest-VolumesTestJSON-382019945 None] Lock "cinder-39fb8a64-816a-4970-a8af-ca95e8ce89da-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-0d35bb37-233f-4d7c-827c-02b784caa43d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "cinder-0d35bb37-233f-4d7c-827c-02b784caa43d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Acquiring lock "cinder-quobyte-0d35bb37-233f-4d7c-827c-02b784caa43d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (dade0c22-f1b4-4766-98c8-a36a17bd944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70b10ea-49e8-45ae-b507-cb27cec2d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-0d35bb37-233f-4d7c-827c-02b784caa43d" acquired by "delete_volume" :: waited 0.098s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70b10ea-49e8-45ae-b507-cb27cec2d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739515090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f93940d4-1ac3-4896-9795-46c37b7e180e,host='devstack@QuobyteHD#QuobyteHD',id=84178b0e-8820-412a-b7c6-f4d6a8f86958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:23Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d11471c-b477-49a3-85d7-a7fd557897aa),volume_type_id=3d11471c-b477-49a3-85d7-a7fd557897aa)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfc76de-739c-458c-aeac-566b82283b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfc76de-739c-458c-aeac-566b82283b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d226f0-c655-4c9b-8fb2-db410ee69e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d226f0-c655-4c9b-8fb2-db410ee69e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84178b0e-8820-412a-b7c6-f4d6a8f86958', 'volume_name': 'volume-84178b0e-8820-412a-b7c6-f4d6a8f86958', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44205e7e-ce1b-4a8f-a7d1-655200193774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44205e7e-ce1b-4a8f-a7d1-655200193774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d1319e-167c-48f5-b3c4-19ff1b48b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Volume 84178b0e-8820-412a-b7c6-f4d6a8f86958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84178b0e-8820-412a-b7c6-f4d6a8f86958', 'volume_size': 1}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4026e-310d-4310-aa10-3ad698e18263]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:23 devstack sudo[94437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d
Sep 20 16:54:23 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:24 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d" returned: 0 in 0.821s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:24 devstack sudo[94442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d
Sep 20 16:54:24 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:24 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0d35bb37-233f-4d7c-827c-02b784caa43d" returned: 0 in 0.563s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "cinder-quobyte-0d35bb37-233f-4d7c-827c-02b784caa43d" released by "delete_volume" :: held 1.536s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:24 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Created reservations ['147cd82e-ab62-42bb-a79c-afe5211449ca', '365baa77-590d-4a91-a8ee-fb59c0e4a3c0', '8e57ffa7-de0d-4f5f-8912-e3c11e522976', '36b64b46-5ff3-4fc5-8282-153fb7092f4b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:25 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:25 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:25 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Deleted volume successfully.
Sep 20 16:54:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-100084f8-a1d0-4d21-b950-810595cdeebd tempest-VolumesTestJSON-382019945 None] Lock "cinder-0d35bb37-233f-4d7c-827c-02b784caa43d-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:29 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c" returned: 0 in 9.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fd407-8a2d-451c-b943-7ad91ed1edee]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:30 devstack sudo[94450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:30 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:30 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.633s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:54:30 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Converted 1024.00 MB image at 109.30 MB/s
Sep 20 16:54:30 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c is being set with open permissions: ugo+rw
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:30 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c
Sep 20 16:54:30 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:30 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" released by "_copy_volume_from_snapshot" :: held 11.388s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-78853f14-df77-4651-b027-6c0b3fa89a0c" released by "_create_volume_from_snapshot" :: held 11.429s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.454s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.478s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f93940d4-1ac3-4896-9795-46c37b7e180e,created_at=2026-09-20T14:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739515090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f93940d4-1ac3-4896-9795-46c37b7e180e,host='devstack@QuobyteHD#QuobyteHD',id=84178b0e-8820-412a-b7c6-f4d6a8f86958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2fb11732748a9a8b65e3c3b756f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:23Z,use_quota=True,user_id='ab5c62870a3f4678880d24dcb8109964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d11471c-b477-49a3-85d7-a7fd557897aa),volume_type_id=3d11471c-b477-49a3-85d7-a7fd557897aa)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Creating volume 84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:30 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:30 devstack sudo[94458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 1073741824
Sep 20 16:54:30 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93587073-dc0e-416e-9627-a008d10fb8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78853f14-df77-4651-b027-6c0b3fa89a0c', 'volume_size': 1, 'snapshot_id': 'c99c4c89-deef-42d5-bcf7-505e21aa2bfa'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd81089-429a-402c-b4f7-bf2d51f6a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:30 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Volume volume-78853f14-df77-4651-b027-6c0b3fa89a0c (78853f14-df77-4651-b027-6c0b3fa89a0c): created successfully
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd81089-429a-402c-b4f7-bf2d51f6a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Flow 'volume_create_manager' (802ea6e8-c33f-488a-9e7b-e246909aae2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d46b5ed9-4e71-4fa7-ac9f-5481e85c13c1 tempest-VolumesSnapshotTestJSON-106406804 None] Created volume successfully.
Sep 20 16:54:31 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 1073741824" returned: 0 in 0.606s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:31 devstack sudo[94464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958
Sep 20 16:54:31 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-78853f14-df77-4651-b027-6c0b3fa89a0c-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-78853f14-df77-4651-b027-6c0b3fa89a0c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf4218-4759-4560-8565-e38eb8f974c4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:31 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958" returned: 0 in 0.402s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d1319e-167c-48f5-b3c4-19ff1b48b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84178b0e-8820-412a-b7c6-f4d6a8f86958', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e3a33-3167-4b0c-b360-dbf93148329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Volume volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 (84178b0e-8820-412a-b7c6-f4d6a8f86958): created successfully
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e3a33-3167-4b0c-b360-dbf93148329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Flow 'volume_create_manager' (dade0c22-f1b4-4766-98c8-a36a17bd944c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-70245aa6-9d66-432b-b9c3-da8ecc5690a0 tempest-GroupSnapshotsTest-1935343413 None] Created volume successfully.
Sep 20 16:54:32 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c
Sep 20 16:54:32 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:32 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c" returned: 0 in 0.469s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:32 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c
Sep 20 16:54:32 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] GroupSnapshot 09b74bae-566c-47c9-98cd-534d6adc217e: creating.
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Group snapshot 09b74bae-566c-47c9-98cd-534d6adc217e: creating. {{(pid=85945) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:32 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78853f14-df77-4651-b027-6c0b3fa89a0c" returned: 0 in 0.355s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Creating offline snapshot 044b818f-e3f0-47ce-845e-8e2733a0db0f of volume 84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-78853f14-df77-4651-b027-6c0b3fa89a0c" released by "delete_volume" :: held 0.883s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3091cfe8-8e38-45e4-8a05-5b2e905684cf]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['20f68960-222c-475d-a1f5-08eecde9b2ed', '4964a072-c0a6-4056-94ee-b939b034e0a0', 'fc07c8a4-b8d7-470c-a235-9ce39751777c', '476665e0-68f2-4d4d-a2b3-72b14c5f87ea'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:33 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958
Sep 20 16:54:33 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:33 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:33 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:33 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Deleted volume successfully.
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-33a38813-81a9-4c19-bd82-5b6261266ae6 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-78853f14-df77-4651-b027-6c0b3fa89a0c-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:33 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958" returned: 0 in 0.610s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:33 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f 1G
Sep 20 16:54:33 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:33 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f 1G" returned: 0 in 0.537s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:33 devstack sudo[94491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f
Sep 20 16:54:33 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Deleting offline snapshot c99c4c89-deef-42d5-bcf7-505e21aa2bfa of volume f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] snapshot_file for this snap is: volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ef7013-5d82-48be-8927-cc8169ec5840]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:34 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f" returned: 0 in 0.421s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:34 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:34 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f
Sep 20 16:54:34 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:34 devstack sudo[94496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:34 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:34 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f" returned: 0 in 0.287s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:34 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.464s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0813a82-af97-4af4-8e34-31666ea026fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:34 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info
Sep 20 16:54:34 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[462decb5-272c-4abd-a3ff-fa6e27ffc638]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:34 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:34 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:35 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:35 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:35 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info
Sep 20 16:54:35 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:35 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.info" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:35 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.535s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:35 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:35 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e1ddf430-584c-4b1a-8030-056ee8b5fbbb tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 09b74bae-566c-47c9-98cd-534d6adc217e: created successfully
Sep 20 16:54:35 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:35 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa
Sep 20 16:54:35 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:36 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd.c99c4c89-deef-42d5-bcf7-505e21aa2bfa" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-c99c4c89-deef-42d5-bcf7-505e21aa2bfa" released by "_delete_snapshot" :: held 1.849s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" released by "delete_snapshot" :: held 1.880s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 09b74bae-566c-47c9-98cd-534d6adc217e: deleting
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['0cebea18-85c7-4eee-a48f-10e05de424b7', 'fac11fd5-981d-4327-a145-814100beeefc', '9caa381b-10c2-4795-b50c-6f58d70ee36b', '310473a9-b86d-422e-9f3f-569456eea20c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 09b74bae-566c-47c9-98cd-534d6adc217e: deleting {{(pid=85945) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-044b818f-e3f0-47ce-845e-8e2733a0db0f" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-044b818f-e3f0-47ce-845e-8e2733a0db0f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Deleting offline snapshot 044b818f-e3f0-47ce-845e-8e2733a0db0f of volume 84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] snapshot_file for this snap is: volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:54:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Delete snapshot completed successfully.
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaab9c7-7d3c-4987-a258-3f5850dca895]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0720c52-7a47-4992-a62c-7d2b65641bfb tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-c99c4c89-deef-42d5-bcf7-505e21aa2bfa-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:36 devstack sudo[94526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f
Sep 20 16:54:36 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:36 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f" returned: 0 in 0.436s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84178b0e-8820-412a-b7c6-f4d6a8f86958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d78659-6718-403b-b819-ff9643067926]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:37 devstack sudo[94534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958
Sep 20 16:54:37 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:37 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958" returned: 0 in 0.470s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:37 devstack sudo[94541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f
Sep 20 16:54:37 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-f0813a82-af97-4af4-8e34-31666ea026fd-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-f0813a82-af97-4af4-8e34-31666ea026fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[44263da0-58ab-41eb-9a45-753e09df7dfb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75709047-392e-41db-b578-b71d0405dfa1 tempest-GroupsTest-1737315241 None] Group tempest-Group1-2086038150: creating
Sep 20 16:54:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75709047-392e-41db-b578-b71d0405dfa1 tempest-GroupsTest-1737315241 None] Group tempest-Group1-2086038150: created successfully
Sep 20 16:54:37 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:37 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75709047-392e-41db-b578-b71d0405dfa1 tempest-GroupsTest-1737315241 None] Create group completed successfully.
Sep 20 16:54:37 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f" returned: 0 in 0.544s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:38 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f
Sep 20 16:54:38 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:38 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.527s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:38 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:38 devstack sudo[94555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd
Sep 20 16:54:38 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958.044b818f-e3f0-47ce-845e-8e2733a0db0f" returned: 0 in 0.306s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-044b818f-e3f0-47ce-845e-8e2733a0db0f" released by "_delete_snapshot" :: held 1.913s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" released by "delete_snapshot" :: held 1.955s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:38 devstack cinder-volume[85945]: WARNING cinder.quota [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1192560453 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1192560453, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:38 devstack cinder-volume[85945]: WARNING cinder.quota [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1192560453 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1192560453, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['098fb6a5-4910-412c-af04-cffc4e61b272', '082a62f7-fdf7-4c66-bcfc-ebe0da090172', '17533cd0-fadc-415e-85c3-97ba91a85fde', '4a4f4da6-ca83-4fb4-97ea-891e22b0371b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dab5242e-8594-4c08-9873-272567e77ac3 tempest-GroupSnapshotsTest-1935343413 None] group_snapshot 09b74bae-566c-47c9-98cd-534d6adc217e: deleted successfully
Sep 20 16:54:38 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f0813a82-af97-4af4-8e34-31666ea026fd" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-f0813a82-af97-4af4-8e34-31666ea026fd" released by "delete_volume" :: held 0.966s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['de1953bb-d8a9-4ef4-825a-bf8b62ea5e23', '4e3825b7-4793-4785-8fed-24042b72ff52', '75ab2c85-62b4-4f1d-a1ef-01f074c0f238', '7561e71b-e8a0-4912-8f0e-1f21db81d922'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:38 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:38 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ff8b27ad-8206-4a55-88cf-d0f4dabb9079 tempest-GroupsTest-1737315241 None] Group tempest-Group2-1126387443: creating
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:39 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.448s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Deleted volume successfully.
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[69668d44-7658-421a-a8d7-aa3b537a1edf]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ff8b27ad-8206-4a55-88cf-d0f4dabb9079 tempest-GroupsTest-1737315241 None] Group tempest-Group2-1126387443: created successfully
Sep 20 16:54:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ff8b27ad-8206-4a55-88cf-d0f4dabb9079 tempest-GroupsTest-1737315241 None] Create group completed successfully.
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a1b57b7-7363-497a-b084-ed6eb868fa0d tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-f0813a82-af97-4af4-8e34-31666ea026fd-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:39 devstack sudo[94578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958
Sep 20 16:54:39 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:39 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:39 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958
Sep 20 16:54:39 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-becedf08-5758-4049-b21d-01b60d0f5536-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-becedf08-5758-4049-b21d-01b60d0f5536-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a62eb6-f8ba-428c-bb36-d33e864bb819]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84178b0e-8820-412a-b7c6-f4d6a8f86958" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Lock "cinder-quobyte-84178b0e-8820-412a-b7c6-f4d6a8f86958" released by "delete_volume" :: held 0.829s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['34063f6e-3b6c-4424-bfdf-c67bf1acf4e8'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:40 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536
Sep 20 16:54:40 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:40 devstack cinder-volume[85945]: WARNING cinder.quota [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1192560453 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1192560453, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Created reservations ['e36e5a51-eb57-49c4-ba12-1570e3f25ca6', 'ba5f31bb-d032-405c-9f64-f75cc8c27352', '8c1a8450-1af6-4ee6-82a6-5a9efcdc5c39', '2ee23212-bf96-471f-9593-111a834615e0'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:40 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:40 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:40 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536" returned: 0 in 0.518s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:40 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536
Sep 20 16:54:40 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:40 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.468s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:40 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-61438019-e5d6-461b-b037-8ef2db1b6168 tempest-GroupSnapshotsTest-1935343413 None] Delete group completed successfully.
Sep 20 16:54:41 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-becedf08-5758-4049-b21d-01b60d0f5536" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-quobyte-becedf08-5758-4049-b21d-01b60d0f5536" released by "delete_volume" :: held 1.056s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Created reservations ['7c86320f-a392-4835-991c-0341ee797583', 'f33cf873-1190-450d-ac92-e6eed6ccbbe6', 'bf963e35-232a-4d32-900d-6d0eb1837e1f', '0c71dfd2-7d64-4729-b421-e7398a510593'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:41 devstack sudo[94600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:41 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (13cb557b-d282-45d0-b239-7b41c1ff3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752327c6-a6cb-4d8b-b09e-e2c7469c9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752327c6-a6cb-4d8b-b09e-e2c7469c9368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039341076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c01c646e-9918-47f8-be9b-70471d1e751b,host='devstack@QuobyteHD#QuobyteHD',id=c200bc72-0533-4bb8-8456-4572ca85c12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:41Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7723135e-c637-496d-a742-4406f7b7d29a),volume_type_id=7723135e-c637-496d-a742-4406f7b7d29a)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b807d4d2-2934-4b3a-bded-44faa2d9c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b807d4d2-2934-4b3a-bded-44faa2d9c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0825dc-fe1b-47f1-9636-c57bf85801b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0825dc-fe1b-47f1-9636-c57bf85801b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c200bc72-0533-4bb8-8456-4572ca85c12a', 'volume_name': 'volume-c200bc72-0533-4bb8-8456-4572ca85c12a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840d5854-ae4a-4dab-8722-4ae3e9e78d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840d5854-ae4a-4dab-8722-4ae3e9e78d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc73ae5-534e-4f99-a1ef-17b03ee56007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:41 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Volume c200bc72-0533-4bb8-8456-4572ca85c12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c200bc72-0533-4bb8-8456-4572ca85c12a', 'volume_size': 1}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c01c646e-9918-47f8-be9b-70471d1e751b,created_at=2026-09-20T14:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039341076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c01c646e-9918-47f8-be9b-70471d1e751b,host='devstack@QuobyteHD#QuobyteHD',id=c200bc72-0533-4bb8-8456-4572ca85c12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:41Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7723135e-c637-496d-a742-4406f7b7d29a),volume_type_id=7723135e-c637-496d-a742-4406f7b7d29a)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Creating volume c200bc72-0533-4bb8-8456-4572ca85c12a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:41 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:41 devstack sudo[94602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a 1073741824
Sep 20 16:54:41 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:41 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.455s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Deleted volume successfully.
Sep 20 16:54:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-85653f83-36a6-408e-82c8-151f47e63519 tempest-VolumesSnapshotTestJSON-106406804 None] Lock "cinder-becedf08-5758-4049-b21d-01b60d0f5536-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:42 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a 1073741824" returned: 0 in 0.918s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:42 devstack sudo[94667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a
Sep 20 16:54:42 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:43 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a" returned: 0 in 0.555s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc73ae5-534e-4f99-a1ef-17b03ee56007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c200bc72-0533-4bb8-8456-4572ca85c12a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9b3f4b-6ae5-4989-a38f-36d883b43b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Volume volume-c200bc72-0533-4bb8-8456-4572ca85c12a (c200bc72-0533-4bb8-8456-4572ca85c12a): created successfully
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9b3f4b-6ae5-4989-a38f-36d883b43b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (13cb557b-d282-45d0-b239-7b41c1ff3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c0cd88ea-8dd7-40fa-aa9f-1241888b99ea tempest-GroupsTest-1737315241 None] Created volume successfully.
Sep 20 16:54:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Acquiring lock "cinder-quobyte-c200bc72-0533-4bb8-8456-4572ca85c12a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:54:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-c200bc72-0533-4bb8-8456-4572ca85c12a" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:54:44 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57d087-db31-4efd-91a1-1967b6abf732]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:45 devstack sudo[94714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a
Sep 20 16:54:45 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:45 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a" returned: 0 in 0.675s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:45 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a
Sep 20 16:54:45 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:46 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c200bc72-0533-4bb8-8456-4572ca85c12a" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-c200bc72-0533-4bb8-8456-4572ca85c12a" released by "delete_volume" :: held 1.174s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=217,cinder:DELETE=14,cinder:SELECT=178,cinder:INSERT=46 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=201,cinder:SELECT=181,cinder:DELETE=12,cinder:INSERT=53 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Created reservations ['f6838179-0950-46fc-8469-bf449815e308'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:46 devstack cinder-volume[85945]: WARNING cinder.quota [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1225504431 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1225504431, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:46 devstack cinder-volume[85945]: WARNING cinder.quota [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1225504431 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1225504431, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Created reservations ['45a9130c-8b47-45c1-bac9-8002d2816287', '9cdd3371-db4f-4722-9197-42ed80d3d9dd', 'bbfe8f98-e065-4f46-844e-685bd87c1caa', '8a4431cc-5e2d-4ed3-bf6c-7e8c5334ff4b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:46 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:46 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:47 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.465s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fe1c1835-7037-432e-aad7-a8d286519ca8 tempest-GroupsTest-1737315241 None] Delete group completed successfully.
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Created reservations ['1f846dc5-86bf-41b2-b018-2fa81cf712fc'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:47 devstack sudo[94729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:47 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:47 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.394s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:47 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c186b319-ed0e-403d-828d-c2304bc604a0 tempest-GroupsTest-1737315241 None] Delete group completed successfully.
Sep 20 16:54:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-53dbfe64-68ea-413e-a2c6-076517d68f79 tempest-GroupsTest-1737315241 None] Group tempest-GroupsTest-Group-458417017: creating
Sep 20 16:54:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-53dbfe64-68ea-413e-a2c6-076517d68f79 tempest-GroupsTest-1737315241 None] Group tempest-GroupsTest-Group-458417017: created successfully
Sep 20 16:54:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-53dbfe64-68ea-413e-a2c6-076517d68f79 tempest-GroupsTest-1737315241 None] Create group completed successfully.
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (acc50a35-12dc-4731-bd4e-b96a2e919b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7e44f6-1681-4afc-b7e1-ee10f7db8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7e44f6-1681-4afc-b7e1-ee10f7db8da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065283932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,host='devstack@QuobyteHD#QuobyteHD',id=d2047884-dbc4-442f-b114-c6c751fd8d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:51Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f13b6c-c8d2-4904-9d6c-e52787d1c880),volume_type_id=23f13b6c-c8d2-4904-9d6c-e52787d1c880)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bf141b-1657-4aa4-a741-860590b6c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bf141b-1657-4aa4-a741-860590b6c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf895a1-1078-41cf-a5b5-9d8255788d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf895a1-1078-41cf-a5b5-9d8255788d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2047884-dbc4-442f-b114-c6c751fd8d3b', 'volume_name': 'volume-d2047884-dbc4-442f-b114-c6c751fd8d3b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb469e0f-bbb9-4c79-9646-0fee1c05ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb469e0f-bbb9-4c79-9646-0fee1c05ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5834c5f6-a5e1-4073-a80e-ae5a104ec10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Volume d2047884-dbc4-442f-b114-c6c751fd8d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2047884-dbc4-442f-b114-c6c751fd8d3b', 'volume_size': 1}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,created_at=2026-09-20T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065283932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,host='devstack@QuobyteHD#QuobyteHD',id=d2047884-dbc4-442f-b114-c6c751fd8d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:51Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f13b6c-c8d2-4904-9d6c-e52787d1c880),volume_type_id=23f13b6c-c8d2-4904-9d6c-e52787d1c880)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Creating volume d2047884-dbc4-442f-b114-c6c751fd8d3b {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:51 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:51 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b 1073741824
Sep 20 16:54:51 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Flow 'volume_create_manager' (f6310222-b126-479e-af80-9388edab87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4620ebb3-b14f-407f-9439-c307503d5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4620ebb3-b14f-407f-9439-c307503d5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-810612099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69ed3d-90ed-4700-9516-55dda340e1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbb240cbe7945b495510002a3fdf7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:52Z,use_quota=True,user_id='9e7213f132de465694fcce64bb1be334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02757a73-6b64-4927-9aca-6a995b8fffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02757a73-6b64-4927-9aca-6a995b8fffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fca1a8c-ac85-43ae-a84b-d7b8314fc7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fca1a8c-ac85-43ae-a84b-d7b8314fc7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf69ed3d-90ed-4700-9516-55dda340e1ab', 'volume_name': 'volume-bf69ed3d-90ed-4700-9516-55dda340e1ab', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dcd9cc-f31f-4b13-983d-09647be1aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dcd9cc-f31f-4b13-983d-09647be1aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6790a1d2-00a5-4e15-bdc1-9781f17fedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Volume bf69ed3d-90ed-4700-9516-55dda340e1ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf69ed3d-90ed-4700-9516-55dda340e1ab', 'volume_size': 1}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:52 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b 1073741824" returned: 0 in 0.982s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:52 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b
Sep 20 16:54:52 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:53 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b" returned: 0 in 0.538s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-810612099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69ed3d-90ed-4700-9516-55dda340e1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbb240cbe7945b495510002a3fdf7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:52Z,use_quota=True,user_id='9e7213f132de465694fcce64bb1be334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Creating volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5834c5f6-a5e1-4073-a80e-ae5a104ec10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2047884-dbc4-442f-b114-c6c751fd8d3b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6cb8ac-40a8-4109-967e-687a05eb4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:53 devstack sudo[94764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab 1073741824
Sep 20 16:54:53 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Volume volume-d2047884-dbc4-442f-b114-c6c751fd8d3b (d2047884-dbc4-442f-b114-c6c751fd8d3b): created successfully
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6cb8ac-40a8-4109-967e-687a05eb4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (acc50a35-12dc-4731-bd4e-b96a2e919b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-46ed9ea4-cce4-43c7-ac2f-caa9d8ec9e03 tempest-GroupsTest-1737315241 None] Created volume successfully.
Sep 20 16:54:53 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab 1073741824" returned: 0 in 0.663s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:53 devstack sudo[94771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab
Sep 20 16:54:53 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:54 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6790a1d2-00a5-4e15-bdc1-9781f17fedfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf69ed3d-90ed-4700-9516-55dda340e1ab', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac9a83f-c843-4be9-99b3-aa38df9173c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Volume volume-bf69ed3d-90ed-4700-9516-55dda340e1ab (bf69ed3d-90ed-4700-9516-55dda340e1ab): created successfully
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac9a83f-c843-4be9-99b3-aa38df9173c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Flow 'volume_create_manager' (f6310222-b126-479e-af80-9388edab87f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8e6fca95-10a7-42c6-95eb-f8c104cfe607 tempest-SnapshotsActionsTest-175841179 None] Created volume successfully.
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (63e36398-3249-42a6-9e9b-c4269a0bea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b2e588-1af5-4121-89a7-4f36b30622f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b2e588-1af5-4121-89a7-4f36b30622f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-968999361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,host='devstack@QuobyteHD#QuobyteHD',id=d5ba7333-cca0-46b4-bf75-94ccf302212d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:56Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f13b6c-c8d2-4904-9d6c-e52787d1c880),volume_type_id=23f13b6c-c8d2-4904-9d6c-e52787d1c880)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1a2edc-d285-4ec6-b255-2c7fb4299dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1a2edc-d285-4ec6-b255-2c7fb4299dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c1c7-ed5e-4518-9da6-fedc53a14651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c1c7-ed5e-4518-9da6-fedc53a14651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ba7333-cca0-46b4-bf75-94ccf302212d', 'volume_name': 'volume-d5ba7333-cca0-46b4-bf75-94ccf302212d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf634f6f-a866-4dc7-a4ee-e90801b1d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf634f6f-a866-4dc7-a4ee-e90801b1d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b25bc3a-5ffc-4d0b-875a-c18579c19bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Volume d5ba7333-cca0-46b4-bf75-94ccf302212d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ba7333-cca0-46b4-bf75-94ccf302212d', 'volume_size': 1}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,created_at=2026-09-20T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-968999361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92184ba1-c0ed-4acb-83c5-ca5c30ad30e5,host='devstack@QuobyteHD#QuobyteHD',id=d5ba7333-cca0-46b4-bf75-94ccf302212d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b639cedbd4f41cabff5ce48be94f459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:56Z,use_quota=True,user_id='634a6e01c13a4f82bdba989731369904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f13b6c-c8d2-4904-9d6c-e52787d1c880),volume_type_id=23f13b6c-c8d2-4904-9d6c-e52787d1c880)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Creating volume d5ba7333-cca0-46b4-bf75-94ccf302212d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:54:56 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:56 devstack sudo[94837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d 1073741824
Sep 20 16:54:56 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:56 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d 1073741824" returned: 0 in 0.672s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:57 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d
Sep 20 16:54:57 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:57 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d" returned: 0 in 0.522s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.233s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b25bc3a-5ffc-4d0b-875a-c18579c19bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ba7333-cca0-46b4-bf75-94ccf302212d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd863f96-9d01-44cd-a6c4-c7da176fd76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Creating offline snapshot cdb84bc0-cb18-4d58-9abc-e2d3cf64563a of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:54:57 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Volume volume-d5ba7333-cca0-46b4-bf75-94ccf302212d (d5ba7333-cca0-46b4-bf75-94ccf302212d): created successfully
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd863f96-9d01-44cd-a6c4-c7da176fd76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Flow 'volume_create_manager' (63e36398-3249-42a6-9e9b-c4269a0bea3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[31459625-8af1-465e-8c2c-33f3e1ea7a93]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-38deddf5-968c-4468-8177-53eb4b0c6ddc tempest-GroupsTest-1737315241 None] Created volume successfully.
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Flow 'volume_create_manager' (fcfbc4f7-9caa-45da-b47b-d5da2c3aff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00e127b-12bd-4db6-a15f-4c00ee45c52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00e127b-12bd-4db6-a15f-4c00ee45c52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1620048245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa9d0c9-f997-4f65-93b6-765f52ec6bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068068a8bd884b6e9b8ef0308ce8af24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:58Z,use_quota=True,user_id='c134d2d48dee4504a38e44f4245a8abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15364d5-def6-4677-9bd2-da43b983804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15364d5-def6-4677-9bd2-da43b983804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dfac41-d0d4-4dea-8da8-3ddf1f1be36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dfac41-d0d4-4dea-8da8-3ddf1f1be36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa9d0c9-f997-4f65-93b6-765f52ec6bdc', 'volume_name': 'volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc', 'volume_size': 2}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab
Sep 20 16:54:57 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2dc395-71eb-4550-bec1-767145612ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2dc395-71eb-4550-bec1-767145612ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5251822-4055-440d-a2aa-968443f653a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:54:57 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Volume bfa9d0c9-f997-4f65-93b6-765f52ec6bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc', 'volume_size': 2}
Sep 20 16:54:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:58 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab" returned: 0 in 0.421s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:58 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a 1G
Sep 20 16:54:58 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:58 devstack sudo[94856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:54:58 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:58 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:54:58 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a 1G" returned: 0 in 0.469s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:58 devstack sudo[94864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:54:58 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:58 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.383s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:58 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a is being set with open permissions: ugo+rw
Sep 20 16:54:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:58 devstack sudo[94869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:54:58 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:59 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-43ab757e-7fc5-4ec1-8fab-3ee1824a8587 tempest-GroupsTest-1737315241 None] Update group completed successfully.
Sep 20 16:54:59 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.322s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:59 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info
Sep 20 16:54:59 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:59 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info" returned: 0 in 0.351s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:54:59 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info is being set with open permissions: ugo+rw
Sep 20 16:54:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:54:59 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info
Sep 20 16:54:59 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:54:59 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Sep 20 16:54:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.info" returned: 0 in 0.342s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1620048245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa9d0c9-f997-4f65-93b6-765f52ec6bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068068a8bd884b6e9b8ef0308ce8af24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:54:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:54:58Z,use_quota=True,user_id='c134d2d48dee4504a38e44f4245a8abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Creating volume bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:00 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc 2147483648 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-79365941-19d9-4142-8804-1e81a15f26e3 tempest-SnapshotsActionsTest-175841179 None] Create snapshot completed successfully
Sep 20 16:55:00 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc 2147483648
Sep 20 16:55:00 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dbb5509e-555c-446c-8f46-60eedb3c6d17 tempest-GroupsTest-1737315241 None] Update group completed successfully.
Sep 20 16:55:00 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc 2147483648" returned: 0 in 0.819s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:00 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc
Sep 20 16:55:00 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:01 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5251822-4055-440d-a2aa-968443f653a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc', 'volume_size': 2}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267be6d8-5747-4005-833c-1cdef223018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:01 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Volume volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc (bfa9d0c9-f997-4f65-93b6-765f52ec6bdc): created successfully
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267be6d8-5747-4005-833c-1cdef223018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Flow 'volume_create_manager' (fcfbc4f7-9caa-45da-b47b-d5da2c3aff1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bf85428a-1747-44b7-80f5-93bab41c5622 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Created volume successfully.
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Creating offline snapshot 11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802fd33-5eb6-44a1-9e34-dfe26511a633]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:01 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:01 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:01 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.437s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:02 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b 1G
Sep 20 16:55:02 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b 1G" returned: 0 in 0.582s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:02 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:02 devstack sudo[94936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b
Sep 20 16:55:02 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Acquiring lock "cinder-quobyte-d2047884-dbc4-442f-b114-c6c751fd8d3b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-d2047884-dbc4-442f-b114-c6c751fd8d3b" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4fd706-083b-48bd-abaa-31924e86959a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Flow 'volume_create_manager' (b9ba200d-5186-412d-a799-0f377688799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee79a16-9456-43a5-9c99-095e351f88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee79a16-9456-43a5-9c99-095e351f88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1128234987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e04d64-5293-43c3-9b2b-d3318b2a9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6888d49172e42e7b2bf44f4d90233c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:03Z,use_quota=True,user_id='3dada6a10b9b44948c01b8eef7fabd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d61e14b-1a05-47e0-a4c4-61d97ae0bc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d61e14b-1a05-47e0-a4c4-61d97ae0bc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92780e75-5f56-481e-827e-207108ba122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92780e75-5f56-481e-827e-207108ba122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e04d64-5293-43c3-9b2b-d3318b2a9049', 'volume_name': 'volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87752692-53bb-4d13-8bf8-70468d32bee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87752692-53bb-4d13-8bf8-70468d32bee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f2c285-4709-41c7-bf3a-c7295a19a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:02 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Volume c5e04d64-5293-43c3-9b2b-d3318b2a9049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049', 'volume_size': 1}
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:02 devstack sudo[94938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b
Sep 20 16:55:02 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:02 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" returned: 0 in 0.326s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:02 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b is being set with open permissions: ugo+rw
Sep 20 16:55:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:02 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b
Sep 20 16:55:02 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:03 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b" returned: 0 in 0.420s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:03 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:03 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b
Sep 20 16:55:03 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.721s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Creating offline snapshot 7e523be9-dfa4-48e4-9b30-00619a5c8010 of volume bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:55:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-65effd49-73ff-49e1-960f-1f5d4fabcd0a tempest-SnapshotsActionsTest-175841179 None] Create snapshot completed successfully
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[47532be4-f51e-4ce5-87fb-4a75f0b227ba]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:03 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc
Sep 20 16:55:03 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:03 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d2047884-dbc4-442f-b114-c6c751fd8d3b" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-d2047884-dbc4-442f-b114-c6c751fd8d3b" released by "delete_volume" :: held 0.754s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Acquiring lock "cinder-quobyte-d5ba7333-cca0-46b4-bf75-94ccf302212d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-d5ba7333-cca0-46b4-bf75-94ccf302212d" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[55328946-1843-43c3-b2c3-abb7e060621a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:03 devstack sudo[94954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d
Sep 20 16:55:03 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:03 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" returned: 0 in 0.472s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 2G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:03 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 2G
Sep 20 16:55:03 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Deleting offline snapshot 11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] snapshot_file for this snap is: volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[38911ce1-46b8-4821-8cfa-f97cabf559a2]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:04 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d" returned: 0 in 0.634s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:04 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b
Sep 20 16:55:04 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:04 devstack sudo[94969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d
Sep 20 16:55:04 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:04 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 2G" returned: 0 in 0.648s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:04 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010
Sep 20 16:55:04 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:04 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d5ba7333-cca0-46b4-bf75-94ccf302212d" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:04 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" returned: 0 in 0.474s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "cinder-quobyte-d5ba7333-cca0-46b4-bf75-94ccf302212d" released by "delete_volume" :: held 1.030s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a007b2a-0b58-4ebb-a2f8-6cb774e852bb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Created reservations ['c9628e97-7f08-4ac3-afdd-1ab10073490b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:04 devstack cinder-volume[85945]: WARNING cinder.quota [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-313600035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-313600035, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:55:04 devstack cinder-volume[85945]: WARNING cinder.quota [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-313600035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-313600035, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:55:04 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:04 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Created reservations ['0729da8a-0e18-484c-861d-b75a2a346638', 'e10193df-0fa1-4d67-b0ec-b0cd6a679e58', 'ad219c0c-c4de-4326-8bbb-5d94c2d68ad7', '75dee4ec-46be-456d-9e9a-8926bcc54f81'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:04 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:04 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 is being set with open permissions: ugo+rw
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:04 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010
Sep 20 16:55:04 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Created reservations ['6237d26b-3698-4e60-8afb-282f81a7acfe', '597a9c22-9b71-495b-af46-5a6317b27842', '884bd86d-b5f9-43f9-b240-c18eaa063c44', '7b6fce96-dead-447c-8a80-18dcaf2eaa11'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:04 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.521s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:05 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:05 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:05 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b
Sep 20 16:55:05 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:05 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:05 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info
Sep 20 16:55:05 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:05 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b3f0d89b-1350-4df8-be0a-05167b0d5022 tempest-GroupsTest-1737315241 None] Delete group completed successfully.
Sep 20 16:55:05 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info" returned: 0 in 0.433s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info is being set with open permissions: ugo+rw
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" returned: 0 in 0.608s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:05 devstack sudo[95001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info
Sep 20 16:55:05 devstack sudo[95002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b
Sep 20 16:55:05 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:05 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:05 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.info" returned: 0 in 0.323s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b" released by "_delete_snapshot" :: held 2.048s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.118s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1128234987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e04d64-5293-43c3-9b2b-d3318b2a9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6888d49172e42e7b2bf44f4d90233c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:03Z,use_quota=True,user_id='3dada6a10b9b44948c01b8eef7fabd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Creating volume c5e04d64-5293-43c3-9b2b-d3318b2a9049 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:05 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:06 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 1073741824
Sep 20 16:55:06 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_snapshot" :: held 2.122s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fa0a602d-29a8-4842-80d6-cedc91270d23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Create snapshot completed successfully
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Created reservations ['f4a6a66d-bf1c-4d13-83dc-d4d915650392', 'e6418ed9-cdb6-4ce7-b58b-e1ae7db19d0c', '6aba3146-38af-4dca-be36-27d2d19781ab', '9516eed4-5c32-425a-9791-3d07b8ebe2a4'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Delete snapshot completed successfully.
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b56f9cd-4f8d-45ae-9a08-76983e42e276 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-11e6fdc3-99f3-48a7-bfe7-c0eaf9b5253b-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:06 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 1073741824" returned: 0 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:06 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049
Sep 20 16:55:06 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:06 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f2c285-4709-41c7-bf3a-c7295a19a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d02942-5c16-46ca-a127-d6ddef81b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "cinder-7e523be9-dfa4-48e4-9b30-00619a5c8010-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:06 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Volume volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 (c5e04d64-5293-43c3-9b2b-d3318b2a9049): created successfully
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d02942-5c16-46ca-a127-d6ddef81b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Flow 'volume_create_manager' (b9ba200d-5186-412d-a799-0f377688799c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-7e523be9-dfa4-48e4-9b30-00619a5c8010-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2b822c33-b91b-4ec3-8680-c6c70943ba27 tempest-ServersNegativeTestJSON-991605671 None] Created volume successfully.
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "cinder-quobyte-7e523be9-dfa4-48e4-9b30-00619a5c8010" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-7e523be9-dfa4-48e4-9b30-00619a5c8010" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Deleting offline snapshot 7e523be9-dfa4-48e4-9b30-00619a5c8010 of volume bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] snapshot_file for this snap is: volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d246bde-e919-456e-b922-fa3fc87d8f72]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:07 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010
Sep 20 16:55:07 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Creating offline snapshot f6fb07a6-5339-486d-9bbd-48be8af700c7 of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:55:07 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010" returned: 0 in 0.603s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e248efe6-0a92-4c6f-b33b-0a13a5e79163]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3834b61-de7e-4e46-a930-c67d04843678]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:07 devstack sudo[95022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc
Sep 20 16:55:07 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:07 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:07 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:08 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" returned: 0 in 0.470s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:08 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.512s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:08 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010
Sep 20 16:55:08 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:08 devstack sudo[95032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 1G
Sep 20 16:55:08 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:08 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010" returned: 0 in 0.464s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:08 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010
Sep 20 16:55:08 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:08 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 1G" returned: 0 in 0.659s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:08 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7
Sep 20 16:55:08 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:09 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc.7e523be9-dfa4-48e4-9b30-00619a5c8010" returned: 0 in 0.473s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-7e523be9-dfa4-48e4-9b30-00619a5c8010" released by "_delete_snapshot" :: held 2.220s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" released by "delete_snapshot" :: held 2.271s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Flow 'volume_create_manager' (45b2c8a0-e7da-4f44-9cd8-4fc38bb2ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd68df-ea55-44e2-b423-71dcdaef4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd68df-ea55-44e2-b423-71dcdaef4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-92507957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e392b82-8803-4f20-90c8-f11d8b6f6533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6888d49172e42e7b2bf44f4d90233c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:09Z,use_quota=True,user_id='3dada6a10b9b44948c01b8eef7fabd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae97ebf-27dd-4975-9906-00075026dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae97ebf-27dd-4975-9906-00075026dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c948ed-7d27-44ce-82b4-71777a1923ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c948ed-7d27-44ce-82b4-71777a1923ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e392b82-8803-4f20-90c8-f11d8b6f6533', 'volume_name': 'volume-7e392b82-8803-4f20-90c8-f11d8b6f6533', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9b6dbe-9deb-48a2-8889-61a836a188e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9b6dbe-9deb-48a2-8889-61a836a188e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09257ead-20ee-4323-a41f-42e3afbdead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Volume 7e392b82-8803-4f20-90c8-f11d8b6f6533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e392b82-8803-4f20-90c8-f11d8b6f6533', 'volume_size': 1}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:09 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7" returned: 0 in 0.538s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:09 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 is being set with open permissions: ugo+rw
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:09 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7
Sep 20 16:55:09 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Created reservations ['fa39b6aa-b124-4b93-946a-5d013fe69bb4', 'de7714b7-101b-4392-bd25-53f084ce178b', '0b205332-c261-4f49-b49c-59cbf4f42724', '2bc906ac-64e2-4e9e-80a9-d5f7f165b0e2'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Delete snapshot completed successfully.
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49873d99-942e-45f2-86f1-3de349177b23 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-7e523be9-dfa4-48e4-9b30-00619a5c8010-delete_snapshot" released by "delete_snapshot" :: held 2.586s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:09 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7" returned: 0 in 0.304s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-92507957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e392b82-8803-4f20-90c8-f11d8b6f6533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6888d49172e42e7b2bf44f4d90233c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:09Z,use_quota=True,user_id='3dada6a10b9b44948c01b8eef7fabd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Creating volume 7e392b82-8803-4f20-90c8-f11d8b6f6533 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:09 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:09 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 1073741824
Sep 20 16:55:09 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-22e3f0b9-bcc3-44f2-ac8e-a8ca15af1bb8 tempest-SnapshotsActionsTest-175841179 None] Create snapshot completed successfully
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "cinder-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:10 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 1073741824" returned: 0 in 0.549s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:10 devstack sudo[95391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533
Sep 20 16:55:10 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7289200c-4a7a-4c45-b5c3-5e74feebe5fa]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:10 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc
Sep 20 16:55:10 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:10 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09257ead-20ee-4323-a41f-42e3afbdead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e392b82-8803-4f20-90c8-f11d8b6f6533', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db65f0-b25b-4f22-922e-2a27158c534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:10 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Volume volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 (7e392b82-8803-4f20-90c8-f11d8b6f6533): created successfully
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db65f0-b25b-4f22-922e-2a27158c534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Flow 'volume_create_manager' (45b2c8a0-e7da-4f44-9cd8-4fc38bb2ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-96469aae-fcd9-415a-8dc1-edbdb08a7b27 tempest-ServersNegativeTestJSON-991605671 None] Created volume successfully.
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-f6fb07a6-5339-486d-9bbd-48be8af700c7-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:10 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" returned: 0 in 0.458s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-f6fb07a6-5339-486d-9bbd-48be8af700c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:10 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc
Sep 20 16:55:10 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-f6fb07a6-5339-486d-9bbd-48be8af700c7" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-f6fb07a6-5339-486d-9bbd-48be8af700c7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Deleting offline snapshot f6fb07a6-5339-486d-9bbd-48be8af700c7 of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] snapshot_file for this snap is: volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ee577-eaea-41eb-ad18-2f7246ee628c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:11 devstack sudo[95401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7
Sep 20 16:55:11 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:11 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" returned: 0 in 0.318s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-quobyte-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc" released by "delete_volume" :: held 0.875s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Created reservations ['b4777a48-ad40-4888-a242-cdf5ebb3eac8', 'c89ec296-7697-45d2-9d25-38ec2ad078cb', 'ef25d556-078e-44bc-bb37-a1408c272641', '71b9f02e-8a51-4ff0-9e89-26925e449f45'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:11 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:11 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:11 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7" returned: 0 in 0.562s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[757dd2f2-6424-4081-8bca-49ab05affade]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:11 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.293s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Deleted volume successfully.
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7bc4177d-e491-4714-acbd-357340f5fef8 tempest-VolumesSnapshotNegativeTestJSON-1495458482 None] Lock "cinder-bfa9d0c9-f997-4f65-93b6-765f52ec6bdc-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:11 devstack sudo[95409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:11 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "cinder-7e392b82-8803-4f20-90c8-f11d8b6f6533-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-7e392b82-8803-4f20-90c8-f11d8b6f6533-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "cinder-quobyte-7e392b82-8803-4f20-90c8-f11d8b6f6533" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-quobyte-7e392b82-8803-4f20-90c8-f11d8b6f6533" acquired by "delete_volume" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[42402e57-257f-4e5c-b2ff-93471bb7d05e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:12 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533
Sep 20 16:55:12 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:12 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.595s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:12 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7
Sep 20 16:55:12 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:12 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533" returned: 0 in 0.469s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:12 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533
Sep 20 16:55:12 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:12 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7" returned: 0 in 0.458s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:12 devstack sudo[95430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7
Sep 20 16:55:12 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:12 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7e392b82-8803-4f20-90c8-f11d8b6f6533" returned: 0 in 0.334s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-quobyte-7e392b82-8803-4f20-90c8-f11d8b6f6533" released by "delete_volume" :: held 0.875s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Created reservations ['5f17497a-9c07-4b44-bdb4-c58fb3452fc6', '2f28e35a-c666-4af1-a86e-01a31eef4e72', '41a17d84-7d8b-4d57-8181-c539c0485220', 'eb5f0730-d7f1-4035-b99f-d94954dcd601'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:12 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.f6fb07a6-5339-486d-9bbd-48be8af700c7" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-f6fb07a6-5339-486d-9bbd-48be8af700c7" released by "_delete_snapshot" :: held 2.086s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_snapshot" :: held 2.134s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:13 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:13 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "cinder-c5e04d64-5293-43c3-9b2b-d3318b2a9049-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Created reservations ['aa97f8cc-0fbf-4371-b4d1-79377998f896', '9c07cf13-2579-4d4d-a1c0-ac35e761837c', '03ebe4ec-45e6-4b61-9c63-b60a9a0f4292', 'c4b2edb8-d633-4ad7-9fab-8156ce669959'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-c5e04d64-5293-43c3-9b2b-d3318b2a9049-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "cinder-quobyte-c5e04d64-5293-43c3-9b2b-d3318b2a9049" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-quobyte-c5e04d64-5293-43c3-9b2b-d3318b2a9049" acquired by "delete_volume" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Delete snapshot completed successfully.
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579f813-6b4a-49c5-980f-1fd13d6f1de3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0f8defd-0e4f-40e4-81d9-da7a2b1ad317 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-f6fb07a6-5339-486d-9bbd-48be8af700c7-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:13 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Deleted volume successfully.
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1a119095-2eb1-4f33-9499-20d4190ad314 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-7e392b82-8803-4f20-90c8-f11d8b6f6533-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:13 devstack sudo[95436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049
Sep 20 16:55:13 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:13 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049" returned: 0 in 0.452s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:13 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049
Sep 20 16:55:13 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:14 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c5e04d64-5293-43c3-9b2b-d3318b2a9049" returned: 0 in 0.334s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-quobyte-c5e04d64-5293-43c3-9b2b-d3318b2a9049" released by "delete_volume" :: held 0.852s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Created reservations ['48cee52b-83a5-42f2-94d8-8a56c549ab75', '3d2c0ab1-6288-42a4-9581-6ab5528df956', '5c5b3e8f-bb77-491d-be9d-5dabc5721f66', '87c09803-692c-4e96-9526-869e5041d1c6'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:14 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:14 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:14 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.317s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Deleted volume successfully.
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-acf8608d-b951-4326-9090-04759e363456 tempest-ServersNegativeTestJSON-991605671 None] Lock "cinder-c5e04d64-5293-43c3-9b2b-d3318b2a9049-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Creating offline snapshot 1af9fad1-ab20-445c-a380-ced741f75cc9 of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:55:14 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Flow 'volume_create_manager' (afba354e-3c8a-4f5e-981f-6799fbc457d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea71b348-ed1f-4b94-8a84-343715a4f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f38c0c-969b-4cb9-b2ff-acb0b4285c77]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea71b348-ed1f-4b94-8a84-343715a4f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-870261749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6fa59-3062-4f1c-8dea-992235c87f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559d91ed38b74b3c8a958e99b96c7b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:15Z,use_quota=True,user_id='eed8974033c44c87a4e4d8bfd7de71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcff90a-2ce9-4f5f-8af6-7434de6ddc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcff90a-2ce9-4f5f-8af6-7434de6ddc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f82ce03-c1a5-4477-a7fc-79dd3c5c47cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f82ce03-c1a5-4477-a7fc-79dd3c5c47cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d6fa59-3062-4f1c-8dea-992235c87f92', 'volume_name': 'volume-d9d6fa59-3062-4f1c-8dea-992235c87f92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa6fd36-2a33-4a19-b910-a0829d0f5ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa6fd36-2a33-4a19-b910-a0829d0f5ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccef85c-0c4c-4968-91e9-f07d7ffa6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume d9d6fa59-3062-4f1c-8dea-992235c87f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d6fa59-3062-4f1c-8dea-992235c87f92', 'volume_size': 1}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:15 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:15 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:15 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.618s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:15 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 1G
Sep 20 16:55:15 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:16 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 1G" returned: 0 in 0.586s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:16 devstack sudo[95568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9
Sep 20 16:55:16 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:16 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:16 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 is being set with open permissions: ugo+rw
Sep 20 16:55:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:16 devstack sudo[95574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9
Sep 20 16:55:16 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:16 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-870261749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6fa59-3062-4f1c-8dea-992235c87f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559d91ed38b74b3c8a958e99b96c7b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:15Z,use_quota=True,user_id='eed8974033c44c87a4e4d8bfd7de71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Creating volume d9d6fa59-3062-4f1c-8dea-992235c87f92 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:17 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:17 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 1073741824
Sep 20 16:55:17 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b62ce01b-e66e-48f6-b23f-32c44df791d8 tempest-SnapshotsActionsTest-175841179 None] Create snapshot completed successfully
Sep 20 16:55:17 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 1073741824" returned: 0 in 0.572s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:17 devstack sudo[95584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92
Sep 20 16:55:17 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-1af9fad1-ab20-445c-a380-ced741f75cc9-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-1af9fad1-ab20-445c-a380-ced741f75cc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-1af9fad1-ab20-445c-a380-ced741f75cc9" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-1af9fad1-ab20-445c-a380-ced741f75cc9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Deleting offline snapshot 1af9fad1-ab20-445c-a380-ced741f75cc9 of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:18 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] snapshot_file for this snap is: volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92" returned: 0 in 0.437s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb9e4a-34ff-4b74-9959-ec2ca342c773]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccef85c-0c4c-4968-91e9-f07d7ffa6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d6fa59-3062-4f1c-8dea-992235c87f92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c7d6bb-aee9-48d3-938b-1b81835a6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 (d9d6fa59-3062-4f1c-8dea-992235c87f92): created successfully
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c7d6bb-aee9-48d3-938b-1b81835a6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Flow 'volume_create_manager' (afba354e-3c8a-4f5e-981f-6799fbc457d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8c08a3b0-371c-4a8a-8be4-dc7dacf912c4 tempest-VolumeQuotasAdminTestJSON-445811976 None] Created volume successfully.
Sep 20 16:55:18 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9
Sep 20 16:55:18 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:18 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422717a-953b-4103-a870-ffdad9a10430]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:18 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:18 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:19 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.531s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "cinder-d9d6fa59-3062-4f1c-8dea-992235c87f92-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:19 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9
Sep 20 16:55:19 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "cinder-d9d6fa59-3062-4f1c-8dea-992235c87f92-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "cinder-quobyte-d9d6fa59-3062-4f1c-8dea-992235c87f92" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "cinder-quobyte-d9d6fa59-3062-4f1c-8dea-992235c87f92" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc006d6c-3f85-48cf-a49e-0821d831a353]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:19 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92
Sep 20 16:55:19 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:19 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9" returned: 0 in 0.463s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:19 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9
Sep 20 16:55:19 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:19 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92" returned: 0 in 0.484s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:19 devstack sudo[95613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92
Sep 20 16:55:19 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:19 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.1af9fad1-ab20-445c-a380-ced741f75cc9" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-1af9fad1-ab20-445c-a380-ced741f75cc9" released by "_delete_snapshot" :: held 1.969s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_snapshot" :: held 2.024s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Created reservations ['80872bfc-b5c3-4cb1-8c7f-a50569acd2fc', '490f7b60-7e34-4ff2-a144-faacf21097b6', '94ddea9a-2279-4a99-b776-d5fd42e5eb85', 'f4390de2-4cdf-491f-aa67-bcbf3d9e7694'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Delete snapshot completed successfully.
Sep 20 16:55:20 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e5b1e1c-8aed-489c-98c4-dadb85d07e50 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-1af9fad1-ab20-445c-a380-ced741f75cc9-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d9d6fa59-3062-4f1c-8dea-992235c87f92" returned: 0 in 0.371s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "cinder-quobyte-d9d6fa59-3062-4f1c-8dea-992235c87f92" released by "delete_volume" :: held 0.909s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Created reservations ['d6f21b23-88fe-436e-82ca-d8ea91891d14', '0bd50bcc-2d76-427e-8e88-aed1069f7a1e', '5283d925-55f1-4615-9d47-b18d453e0f7f', '58c9b84c-a261-4d2e-8832-ea96991a8a62'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:20 devstack sudo[95617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:20 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:20 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Deleted volume successfully.
Sep 20 16:55:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-254908a6-29b1-4a6a-bd22-8f94dc9f16b2 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "cinder-d9d6fa59-3062-4f1c-8dea-992235c87f92-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Creating offline snapshot 7d2b9eec-699f-47c4-8d10-eb26df950c7c of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:55:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b3a9fc-ffde-465e-a0dd-15a791e7266f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:21 devstack sudo[95620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:21 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:22 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Flow 'volume_create_manager' (6aebf3bd-faa1-4d8e-b954-3dd807ab494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd84a2b-7fac-4883-957a-80e480c49577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.588s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd84a2b-7fac-4883-957a-80e480c49577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2064969048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5107f58-ca76-4911-b68c-b0feb07cbc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559d91ed38b74b3c8a958e99b96c7b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:22Z,use_quota=True,user_id='eed8974033c44c87a4e4d8bfd7de71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c678187-cce1-49cc-a718-2bca79087e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:22 devstack sudo[95626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c 1G
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c678187-cce1-49cc-a718-2bca79087e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:22 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a2b616-3f1d-4fb8-864d-2c2611acadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a2b616-3f1d-4fb8-864d-2c2611acadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5107f58-ca76-4911-b68c-b0feb07cbc77', 'volume_name': 'volume-b5107f58-ca76-4911-b68c-b0feb07cbc77', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf64c16d-6f53-4581-a0ad-f622fcf59ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf64c16d-6f53-4581-a0ad-f622fcf59ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2502485a-9503-4828-8c77-6b6ffdfd6749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume b5107f58-ca76-4911-b68c-b0feb07cbc77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5107f58-ca76-4911-b68c-b0feb07cbc77', 'volume_size': 1}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:22 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c 1G" returned: 0 in 0.655s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:22 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c
Sep 20 16:55:22 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:23 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:23 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c is being set with open permissions: ugo+rw
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:23 devstack sudo[95637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c
Sep 20 16:55:23 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:23 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c" returned: 0 in 0.305s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2064969048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5107f58-ca76-4911-b68c-b0feb07cbc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559d91ed38b74b3c8a958e99b96c7b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:22Z,use_quota=True,user_id='eed8974033c44c87a4e4d8bfd7de71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Creating volume b5107f58-ca76-4911-b68c-b0feb07cbc77 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:23 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:23 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 1073741824
Sep 20 16:55:23 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3d85cfcd-965d-40c8-b5f2-b4270f0540c7 tempest-SnapshotsActionsTest-175841179 None] Create snapshot completed successfully
Sep 20 16:55:24 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 1073741824" returned: 0 in 0.551s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:24 devstack sudo[95646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77
Sep 20 16:55:24 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:24 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2502485a-9503-4828-8c77-6b6ffdfd6749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5107f58-ca76-4911-b68c-b0feb07cbc77', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe813cb-367f-4e73-bf84-956cbb112223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Volume volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 (b5107f58-ca76-4911-b68c-b0feb07cbc77): created successfully
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe813cb-367f-4e73-bf84-956cbb112223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Flow 'volume_create_manager' (6aebf3bd-faa1-4d8e-b954-3dd807ab494c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c9677ee3-a793-441b-96e0-cb86ae864ba1 tempest-VolumeQuotasAdminTestJSON-445811976 None] Created volume successfully.
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-7d2b9eec-699f-47c4-8d10-eb26df950c7c-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-7d2b9eec-699f-47c4-8d10-eb26df950c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Acquiring lock "cinder-quobyte-7d2b9eec-699f-47c4-8d10-eb26df950c7c" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-7d2b9eec-699f-47c4-8d10-eb26df950c7c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Deleting offline snapshot 7d2b9eec-699f-47c4-8d10-eb26df950c7c of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] snapshot_file for this snap is: volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8364fc-d950-4c1f-8ed5-accf48375d98]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:25 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c
Sep 20 16:55:25 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:25 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c" returned: 0 in 0.517s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da56764-a554-463e-9f60-d3d717f45552]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:25 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:25 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:26 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.508s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:26 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c
Sep 20 16:55:26 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-eccf7e14-0d21-47e9-b3f9-fffbc55d117f tempest-VolumeQuotasAdminTestJSON-269309722 None] Transfer volume completed successfully.
Sep 20 16:55:26 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c" returned: 0 in 0.592s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:26 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c
Sep 20 16:55:26 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:27 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.7d2b9eec-699f-47c4-8d10-eb26df950c7c" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-7d2b9eec-699f-47c4-8d10-eb26df950c7c" released by "_delete_snapshot" :: held 2.204s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_snapshot" :: held 2.241s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Acquiring lock "cinder-b5107f58-ca76-4911-b68c-b0feb07cbc77-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Created reservations ['a38eab07-8670-4d60-94d7-9e798c9e91bf', 'c0918d91-ee12-4c61-a8e9-dcea212f1f6c', 'fc405d81-93a8-4973-a18d-66780901c368', '257915f6-0d8b-48ea-9171-c21a96f0971f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "cinder-b5107f58-ca76-4911-b68c-b0feb07cbc77-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Acquiring lock "cinder-quobyte-b5107f58-ca76-4911-b68c-b0feb07cbc77" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "cinder-quobyte-b5107f58-ca76-4911-b68c-b0feb07cbc77" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Delete snapshot completed successfully.
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2566eea1-1fbc-4308-976b-491993994413 tempest-SnapshotsActionsTest-499410542 None] Lock "cinder-7d2b9eec-699f-47c4-8d10-eb26df950c7c-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab7dea7-d25e-4c69-9b36-2159c9f639c4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:27 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77
Sep 20 16:55:27 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:27 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77" returned: 0 in 0.490s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:28 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77
Sep 20 16:55:28 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:28 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5107f58-ca76-4911-b68c-b0feb07cbc77" returned: 0 in 0.381s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "cinder-quobyte-b5107f58-ca76-4911-b68c-b0feb07cbc77" released by "delete_volume" :: held 0.953s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Created reservations ['9314e257-ef47-4985-9387-85be7a9dcb52', '0ec113de-3e10-4406-8fc7-dc7d650c6c51', '8f0f0c91-2aeb-4740-be27-95ff9bd00285', 'da6c0b40-ae43-4859-90a4-8a6fabe02733'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:28 devstack sudo[95677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:28 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "cinder-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "cinder-quobyte-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Deleting offline snapshot cdb84bc0-cb18-4d58-9abc-e2d3cf64563a of volume bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] snapshot_file for this snap is: volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e44042-1070-4bf0-a629-021127780ed8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:28 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:28 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:28 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:28 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Deleted volume successfully.
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4ce0f6ae-0808-4859-8c10-568bc47f52fa tempest-VolumeQuotasAdminTestJSON-238888099 None] Lock "cinder-b5107f58-ca76-4911-b68c-b0feb07cbc77-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:29 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf69ed3d-90ed-4700-9516-55dda340e1ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2587b24-f6a1-4c85-a7cb-a70616823b65]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:29 devstack sudo[95686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab
Sep 20 16:55:29 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:29 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab" returned: 0 in 0.522s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:29 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:29 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:30 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.542s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:30 devstack sudo[95701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a
Sep 20 16:55:30 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:30 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab.cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a" released by "_delete_snapshot" :: held 2.016s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_snapshot" :: held 2.054s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:30 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Created reservations ['41499e33-8893-4a65-a158-c6b1e73dbf02', '1f3b571a-3d4a-4d84-ac16-a5049b7c1746', '62a2da9d-6db4-436f-828a-691ec9b82e12', 'dcc98618-7157-489c-87ea-cc258164c1ee'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Delete snapshot completed successfully.
Sep 20 16:55:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e2b90cc1-c33a-48bb-a1ea-b790c0b30260 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-cdb84bc0-cb18-4d58-9abc-e2d3cf64563a-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "cinder-bf69ed3d-90ed-4700-9516-55dda340e1ab-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-bf69ed3d-90ed-4700-9516-55dda340e1ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5f02a-89e6-470c-bc42-3e598202e803]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:32 devstack sudo[95704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab
Sep 20 16:55:32 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:32 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:32 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab
Sep 20 16:55:32 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:32 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bf69ed3d-90ed-4700-9516-55dda340e1ab" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-quobyte-bf69ed3d-90ed-4700-9516-55dda340e1ab" released by "delete_volume" :: held 0.815s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Created reservations ['36bba7b7-e33e-4896-ad45-1a0d1e28a032', 'e8f98d35-b0df-4fb5-a71e-c3b835ad95ff', '00949ffc-b761-4041-af6d-dba4d5d15719', '26c77a7f-e61e-462d-9913-08543e00965b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:33 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:33 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:33 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Deleted volume successfully.
Sep 20 16:55:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f3e4086f-d909-49d0-b946-3cea318a9e79 tempest-SnapshotsActionsTest-175841179 None] Lock "cinder-bf69ed3d-90ed-4700-9516-55dda340e1ab-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Flow 'volume_create_manager' (35fd2dae-7712-4965-9f31-5236ca549afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69e111-8481-4c4b-930b-fddf0495379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69e111-8481-4c4b-930b-fddf0495379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-224834974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d83dd-9adc-4975-a5ff-b137455614f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91bfa13bafd4f6591ea77767cfea26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:42Z,use_quota=True,user_id='11592df858f24a92b75a2736924e783e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd06a1a-ca39-49c7-9be3-35fdaeccf215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd06a1a-ca39-49c7-9be3-35fdaeccf215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b75a5-6dc1-47d7-9682-07873dc9cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b75a5-6dc1-47d7-9682-07873dc9cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3d83dd-9adc-4975-a5ff-b137455614f5', 'volume_name': 'volume-de3d83dd-9adc-4975-a5ff-b137455614f5', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ea4014-b5a4-4e14-9fc3-2bb3e509a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ea4014-b5a4-4e14-9fc3-2bb3e509a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8a4f56-438a-4968-9adc-503834dfcf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:42 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Volume de3d83dd-9adc-4975-a5ff-b137455614f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3d83dd-9adc-4975-a5ff-b137455614f5', 'volume_size': 1}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-224834974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d83dd-9adc-4975-a5ff-b137455614f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91bfa13bafd4f6591ea77767cfea26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:42Z,use_quota=True,user_id='11592df858f24a92b75a2736924e783e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Creating volume de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:55:42 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:55:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:42 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 1073741824
Sep 20 16:55:42 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:43 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 1073741824" returned: 0 in 0.598s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:43 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:55:43 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:43 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.309s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8a4f56-438a-4968-9adc-503834dfcf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3d83dd-9adc-4975-a5ff-b137455614f5', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b6dfe1-8091-4c09-afb5-381dd66b7cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Volume volume-de3d83dd-9adc-4975-a5ff-b137455614f5 (de3d83dd-9adc-4975-a5ff-b137455614f5): created successfully
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b6dfe1-8091-4c09-afb5-381dd66b7cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Flow 'volume_create_manager' (35fd2dae-7712-4965-9f31-5236ca549afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a048ee85-6ec7-45fa-addf-c0bc563d002e tempest-TestImageHashVerification-1275727962 None] Created volume successfully.
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21c676-d11d-4cde-b4ce-0093215ffd43]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:46 devstack sudo[95764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:55:46 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:46 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.578s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca948b-8dc9-4092-99d7-ca2178f160ba]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:46 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:55:46 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:47 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.542s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 /opt/stack/data/cinder/conversion/de3d83dd-9adc-4975-a5ff-b137455614f5.temp_image.63d57c88-547e-4ea7-8b07-0f350311d718d1aaocfw.img {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:47 devstack sudo[95776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 /opt/stack/data/cinder/conversion/de3d83dd-9adc-4975-a5ff-b137455614f5.temp_image.63d57c88-547e-4ea7-8b07-0f350311d718d1aaocfw.img
Sep 20 16:55:47 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:50 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=151,cinder:SELECT=128,cinder:INSERT=33,cinder:DELETE=10 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:55:50 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=125,cinder:INSERT=41,cinder:UPDATE=149,cinder:DELETE=11 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:55:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:55:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Flow 'volume_create_manager' (ad5f8212-537a-4f6e-9960-a2e5795d7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:55:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459b339-b4cc-48bc-9b25-151f8c473a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459b339-b4cc-48bc-9b25-151f8c473a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-902187141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d187bb3-34ec-4086-b59f-750d6ec8d672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25255f731ddb45fda8ce0319fa01dedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:51Z,use_quota=True,user_id='237e5fe5352b44c19bcb78f8961f53ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebb38b4-8194-47b7-823e-d5a860382932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebb38b4-8194-47b7-823e-d5a860382932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22acb75a-428a-457b-b7a2-64a34f0d11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22acb75a-428a-457b-b7a2-64a34f0d11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d187bb3-34ec-4086-b59f-750d6ec8d672', 'volume_name': 'volume-3d187bb3-34ec-4086-b59f-750d6ec8d672', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a01088-2643-4e54-adea-15cc7fd8b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a01088-2643-4e54-adea-15cc7fd8b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fc3464-5de5-4398-ab01-e4c78a654baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:55:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Volume 3d187bb3-34ec-4086-b59f-750d6ec8d672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d187bb3-34ec-4086-b59f-750d6ec8d672', 'volume_size': 1}
Sep 20 16:55:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:56 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 /opt/stack/data/cinder/conversion/de3d83dd-9adc-4975-a5ff-b137455614f5.temp_image.63d57c88-547e-4ea7-8b07-0f350311d718d1aaocfw.img" returned: 0 in 9.079s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff128321-32e5-4134-843e-7a1fe7c7e453]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:56 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:55:56 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:56 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.583s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/conversion/de3d83dd-9adc-4975-a5ff-b137455614f5.temp_image.63d57c88-547e-4ea7-8b07-0f350311d718d1aaocfw.img {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:55:56 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Converted 1024.00 MB image at 112.77 MB/s
Sep 20 16:55:56 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] 63d57c88-547e-4ea7-8b07-0f350311d718 was raw, no need to convert to raw {{(pid=85945) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:55:58 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:55:58 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:55:58 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.576s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:55:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:56:06 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:56:06 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:56:10 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:56:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Flow 'volume_create_manager' (ea76d12e-6643-4921-b16f-86899fa88037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11da91a-b5d3-4706-a3a8-d3ffdf6f73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11da91a-b5d3-4706-a3a8-d3ffdf6f73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-255613786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e322823-6595-4605-ae7a-b3d75b30d020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84551d277e9a4034a09871939e4fa652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:11Z,use_quota=True,user_id='06188f6f12d74bcdbda8ff3c19592b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7a1a67b-e9e7-4b16-a555-886865e0f563),volume_type_id=e7a1a67b-e9e7-4b16-a555-886865e0f563)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b3859d-90a7-4908-a1c2-f1fc18d066f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b3859d-90a7-4908-a1c2-f1fc18d066f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76c39b-9196-406a-9a76-25efb3499a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76c39b-9196-406a-9a76-25efb3499a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e322823-6595-4605-ae7a-b3d75b30d020', 'volume_name': 'volume-3e322823-6595-4605-ae7a-b3d75b30d020', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe38090-1e0d-4c01-a97c-e5ec88ab65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe38090-1e0d-4c01-a97c-e5ec88ab65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f852d8db-a4ba-4969-a524-31ecdfe2b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Volume 3e322823-6595-4605-ae7a-b3d75b30d020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e322823-6595-4605-ae7a-b3d75b30d020', 'volume_size': 1}
Sep 20 16:56:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.680s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Uploaded volume to glance image-id: 63d57c88-547e-4ea7-8b07-0f350311d718. {{(pid=85945) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.620s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-902187141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d187bb3-34ec-4086-b59f-750d6ec8d672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25255f731ddb45fda8ce0319fa01dedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:55:51Z,use_quota=True,user_id='237e5fe5352b44c19bcb78f8961f53ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Creating volume 3d187bb3-34ec-4086-b59f-750d6ec8d672 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:20 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:20 devstack sudo[95936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 1073741824
Sep 20 16:56:20 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5af9dbc6-19fe-46e8-b9b8-8f532add274f tempest-TestImageHashVerification-1275727962 None] Copy volume to image completed successfully.
Sep 20 16:56:21 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 1073741824" returned: 0 in 0.482s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:21 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672
Sep 20 16:56:21 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Acquiring lock "cinder-de3d83dd-9adc-4975-a5ff-b137455614f5-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "cinder-de3d83dd-9adc-4975-a5ff-b137455614f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Acquiring lock "cinder-quobyte-de3d83dd-9adc-4975-a5ff-b137455614f5" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "cinder-quobyte-de3d83dd-9adc-4975-a5ff-b137455614f5" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e979d4-a985-4d1b-99e9-1e68e6163e40]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:21 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672" returned: 0 in 0.300s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.578s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-255613786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e322823-6595-4605-ae7a-b3d75b30d020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84551d277e9a4034a09871939e4fa652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:11Z,use_quota=True,user_id='06188f6f12d74bcdbda8ff3c19592b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7a1a67b-e9e7-4b16-a555-886865e0f563),volume_type_id=e7a1a67b-e9e7-4b16-a555-886865e0f563)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Creating volume 3e322823-6595-4605-ae7a-b3d75b30d020 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fc3464-5de5-4398-ab01-e4c78a654baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d187bb3-34ec-4086-b59f-750d6ec8d672', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72891043-9734-43a2-bfe0-f7c3dace820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:21 devstack sudo[95946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 1073741824
Sep 20 16:56:21 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:21 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:56:21 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Volume volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 (3d187bb3-34ec-4086-b59f-750d6ec8d672): created successfully
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72891043-9734-43a2-bfe0-f7c3dace820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Flow 'volume_create_manager' (ad5f8212-537a-4f6e-9960-a2e5795d7245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ebc5fcff-c30c-4891-86b8-b2bbf23e412a tempest-VolumesServicesTestJSON-1329859108 None] Created volume successfully.
Sep 20 16:56:21 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:22 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5
Sep 20 16:56:22 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:22 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 1073741824" returned: 0 in 0.488s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:22 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020
Sep 20 16:56:22 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:22 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-de3d83dd-9adc-4975-a5ff-b137455614f5" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "cinder-quobyte-de3d83dd-9adc-4975-a5ff-b137455614f5" released by "delete_volume" :: held 0.726s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Created reservations ['e250f8da-e17e-4173-b680-2932eb9f1c25', '8bce7cb7-792d-498e-86fa-a6f00c35c8db', '97af5649-be18-483c-a50e-cab8577e4b74', '48687803-7563-4336-aabb-0ab43fbffca2'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:22 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:22 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:22 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f852d8db-a4ba-4969-a524-31ecdfe2b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e322823-6595-4605-ae7a-b3d75b30d020', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea4d714-ef91-493f-abe1-6c94db1af032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Volume volume-3e322823-6595-4605-ae7a-b3d75b30d020 (3e322823-6595-4605-ae7a-b3d75b30d020): created successfully
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea4d714-ef91-493f-abe1-6c94db1af032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Flow 'volume_create_manager' (ea76d12e-6643-4921-b16f-86899fa88037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2075e683-9584-439b-b8bb-9e6710b6dbc6 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Created volume successfully.
Sep 20 16:56:22 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.285s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Deleted volume successfully.
Sep 20 16:56:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-169d27c6-9c78-4daf-b7a8-f64c206b2ab2 tempest-TestImageHashVerification-1275727962 None] Lock "cinder-de3d83dd-9adc-4975-a5ff-b137455614f5-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Acquiring lock "cinder-3d187bb3-34ec-4086-b59f-750d6ec8d672-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "cinder-3d187bb3-34ec-4086-b59f-750d6ec8d672-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Acquiring lock "cinder-quobyte-3d187bb3-34ec-4086-b59f-750d6ec8d672" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "cinder-quobyte-3d187bb3-34ec-4086-b59f-750d6ec8d672" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb00d0-b5a0-4072-9df4-a04cd4efd327]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:23 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:23 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:23 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672
Sep 20 16:56:23 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:23 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-059f2116-89bd-4102-8215-7b3e4caed41f tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Retype volume completed successfully.
Sep 20 16:56:23 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:23 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672
Sep 20 16:56:23 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:23 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d187bb3-34ec-4086-b59f-750d6ec8d672" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "cinder-quobyte-3d187bb3-34ec-4086-b59f-750d6ec8d672" released by "delete_volume" :: held 0.778s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:23 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Created reservations ['fefaefdb-b4e6-4309-bb79-8a629db773e7', '8e1a49af-f90b-4f49-8003-1ea12ea7e3d8', '0bdabcba-6982-499b-b2b8-2dafab2eb749', 'f6b72c94-a6e7-4014-b024-0628fbb68ec3'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:24 devstack sudo[95978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:24 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "cinder-3e322823-6595-4605-ae7a-b3d75b30d020-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "cinder-3e322823-6595-4605-ae7a-b3d75b30d020-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:24 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "cinder-quobyte-3e322823-6595-4605-ae7a-b3d75b30d020" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Deleted volume successfully.
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "cinder-quobyte-3e322823-6595-4605-ae7a-b3d75b30d020" acquired by "delete_volume" :: waited 0.047s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e006fb8-5cd4-4954-ad9e-7f90ae7616fd tempest-VolumesServicesTestJSON-1329859108 None] Lock "cinder-3d187bb3-34ec-4086-b59f-750d6ec8d672-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b18ab6-bc48-4b82-9633-ba4af8f7d61d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:24 devstack sudo[95982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020
Sep 20 16:56:24 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (2eaa7f5e-ef88-4b8d-a1c9-dfb39dfcf503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ee5603-e65a-4502-b5fc-0c6ac4e79493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ee5603-e65a-4502-b5fc-0c6ac4e79493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-944782153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cb44f6-b6e8-4356-aebe-6a4d6d336a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:25Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70746fd-25bd-4603-9b89-28441429b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70746fd-25bd-4603-9b89-28441429b909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e7aedc-6631-45ec-903d-b18f8364ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e7aedc-6631-45ec-903d-b18f8364ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cb44f6-b6e8-4356-aebe-6a4d6d336a2a', 'volume_name': 'volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc03b39-fa5c-4ae8-bb4f-4783b1ff08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc03b39-fa5c-4ae8-bb4f-4783b1ff08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dad2fd-96b0-40ba-ab66-6f2cc1530389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Volume 90cb44f6-b6e8-4356-aebe-6a4d6d336a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a', 'volume_size': 1}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-944782153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cb44f6-b6e8-4356-aebe-6a4d6d336a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:25Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Creating volume 90cb44f6-b6e8-4356-aebe-6a4d6d336a2a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:24 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:24 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a 1073741824
Sep 20 16:56:24 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:25 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020" returned: 0 in 0.467s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:25 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020
Sep 20 16:56:25 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:25 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3e322823-6595-4605-ae7a-b3d75b30d020" returned: 0 in 0.302s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "cinder-quobyte-3e322823-6595-4605-ae7a-b3d75b30d020" released by "delete_volume" :: held 0.839s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:25 devstack cinder-volume[85945]: WARNING cinder.quota [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:25 devstack cinder-volume[85945]: WARNING cinder.quota [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:25 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a 1073741824" returned: 0 in 0.571s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Created reservations ['3f5a2067-4901-472c-a377-7d1bf6c2a05c', '30b53e23-2d5b-443c-8efd-f813a689adc8', 'a0e39e71-baa3-4e7d-99df-2d1acc55be23', '967a52dc-af33-471a-9feb-fad33339e2c1'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:25 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a
Sep 20 16:56:25 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:25 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:25 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:26 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" returned: 0 in 0.511s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dad2fd-96b0-40ba-ab66-6f2cc1530389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319b4265-074a-4c5a-9659-73e6a623d04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:26 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.477s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:26 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Volume volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a (90cb44f6-b6e8-4356-aebe-6a4d6d336a2a): created successfully
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319b4265-074a-4c5a-9659-73e6a623d04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (2eaa7f5e-ef88-4b8d-a1c9-dfb39dfcf503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Deleted volume successfully.
Sep 20 16:56:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-598d5f8c-98ea-4628-a452-bb0c34e11245 tempest-AttachVolumeNegativeTest-210240145 None] Created volume successfully.
Sep 20 16:56:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-32be4a13-e170-4a41-8358-469cfd8412e9 tempest-VolumeRetypeWithoutMigrationTest-1061958660 None] Lock "cinder-3e322823-6595-4605-ae7a-b3d75b30d020-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9d936-5c4f-47cb-850d-ca1e15f78bfc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:28 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a
Sep 20 16:56:28 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:28 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" returned: 0 in 0.520s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.558s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3376733f-271a-4eb0-9c9b-97c029b1159b', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:56:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-b975877b-0db0-4066-82ca-6a000601c01b req-cf6c724c-9a4a-4491-a4af-c016234f48d7 tempest-AttachVolumeNegativeTest-210240145 None] attachment_update completed successfully.
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Flow 'volume_create_manager' (d578fa05-bb25-4b5a-996f-77443aa77932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ca5058-a7a8-4cee-b680-9b9f7ef51823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ca5058-a7a8-4cee-b680-9b9f7ef51823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1264756610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4074365b-106a-495a-911f-f8c4219b17d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8452a24a431f4e2ab5c4eef38f8c665e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:33Z,use_quota=True,user_id='7368012259bb4876aa5d3db92580e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e30f4a3-dde4-43b6-88c0-5dae9e181d44),volume_type_id=5e30f4a3-dde4-43b6-88c0-5dae9e181d44)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848780cf-b02c-4d0f-97e7-4dacf6c73cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848780cf-b02c-4d0f-97e7-4dacf6c73cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aeb413-92ad-40b3-9af4-2e0b851cb1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aeb413-92ad-40b3-9af4-2e0b851cb1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4074365b-106a-495a-911f-f8c4219b17d4', 'volume_name': 'volume-4074365b-106a-495a-911f-f8c4219b17d4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace35d77-92e5-4095-aa87-bb532f12b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace35d77-92e5-4095-aa87-bb532f12b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014af5a-969c-4eb1-b9d0-fee26e00ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Volume 4074365b-106a-495a-911f-f8c4219b17d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4074365b-106a-495a-911f-f8c4219b17d4', 'volume_size': 1}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1264756610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4074365b-106a-495a-911f-f8c4219b17d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8452a24a431f4e2ab5c4eef38f8c665e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:33Z,use_quota=True,user_id='7368012259bb4876aa5d3db92580e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e30f4a3-dde4-43b6-88c0-5dae9e181d44),volume_type_id=5e30f4a3-dde4-43b6-88c0-5dae9e181d44)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Creating volume 4074365b-106a-495a-911f-f8c4219b17d4 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:33 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:33 devstack sudo[96439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 1073741824
Sep 20 16:56:33 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:34 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 1073741824" returned: 0 in 0.628s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:34 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4
Sep 20 16:56:34 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Flow 'volume_create_manager' (5a7401a1-5dde-4385-9c99-69879a587c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b38653f-f493-4b5c-9980-38a36cd2f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b38653f-f493-4b5c-9980-38a36cd2f526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-551351768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f84909b-16a2-4fb1-b3d0-09cca4677153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f2901d212456f87caf055c9a48cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:34Z,use_quota=True,user_id='0104df19dd464260a5731bfe7e038c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821898ec-0852-40de-82fa-b25cfdb73408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821898ec-0852-40de-82fa-b25cfdb73408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7c6d6a-4769-4b91-92a3-3a458b5ae796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7c6d6a-4769-4b91-92a3-3a458b5ae796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f84909b-16a2-4fb1-b3d0-09cca4677153', 'volume_name': 'volume-2f84909b-16a2-4fb1-b3d0-09cca4677153', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d300a46c-314a-4f0b-bd8d-c9b7641bc605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d300a46c-314a-4f0b-bd8d-c9b7641bc605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2cbda-ce32-40df-97a4-ef73faad5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Volume 2f84909b-16a2-4fb1-b3d0-09cca4677153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f84909b-16a2-4fb1-b3d0-09cca4677153', 'volume_size': 1}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-551351768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f84909b-16a2-4fb1-b3d0-09cca4677153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f2901d212456f87caf055c9a48cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:34Z,use_quota=True,user_id='0104df19dd464260a5731bfe7e038c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Creating volume 2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:34 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:34 devstack sudo[96448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 1073741824
Sep 20 16:56:34 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014af5a-969c-4eb1-b9d0-fee26e00ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4074365b-106a-495a-911f-f8c4219b17d4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59be44a9-72f0-4541-814a-8dade4c40740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:34 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Volume volume-4074365b-106a-495a-911f-f8c4219b17d4 (4074365b-106a-495a-911f-f8c4219b17d4): created successfully
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59be44a9-72f0-4541-814a-8dade4c40740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Flow 'volume_create_manager' (d578fa05-bb25-4b5a-996f-77443aa77932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1fad1da4-e5ba-46ee-9e30-fbc51175064b tempest-VolumeTypesAccessTest-1247425917 None] Created volume successfully.
Sep 20 16:56:35 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 1073741824" returned: 0 in 0.568s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:35 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153
Sep 20 16:56:35 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:35 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2cbda-ce32-40df-97a4-ef73faad5004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f84909b-16a2-4fb1-b3d0-09cca4677153', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9ef89f-ed17-4d99-9bab-92a0f7be9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:35 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Volume volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 (2f84909b-16a2-4fb1-b3d0-09cca4677153): created successfully
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9ef89f-ed17-4d99-9bab-92a0f7be9e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Flow 'volume_create_manager' (5a7401a1-5dde-4385-9c99-69879a587c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-eb6660df-13db-4569-9a9f-c2cb25ac6e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Created volume successfully.
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Acquiring lock "cinder-4074365b-106a-495a-911f-f8c4219b17d4-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "cinder-4074365b-106a-495a-911f-f8c4219b17d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Acquiring lock "cinder-quobyte-4074365b-106a-495a-911f-f8c4219b17d4" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "cinder-quobyte-4074365b-106a-495a-911f-f8c4219b17d4" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df818af-17fb-474b-a188-5e0bc92f5c2e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:35 devstack sudo[96461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4
Sep 20 16:56:35 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:36 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4" returned: 0 in 0.473s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:36 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4
Sep 20 16:56:36 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:36 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4074365b-106a-495a-911f-f8c4219b17d4" returned: 0 in 0.400s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "cinder-quobyte-4074365b-106a-495a-911f-f8c4219b17d4" released by "delete_volume" :: held 0.947s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:36 devstack cinder-volume[85945]: WARNING cinder.quota [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-659051375 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-659051375, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:36 devstack cinder-volume[85945]: WARNING cinder.quota [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-659051375 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-659051375, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Created reservations ['7c4d169a-be36-402e-9196-a976ea7e386a', '6df46b7c-3bcd-4e1e-8930-c732049bcaf1', '2fec3b36-0aa7-4f35-85c9-8fb310318d78', 'c7827b93-f3b2-41c7-97dd-0c2ffb3dd71f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:37 devstack sudo[96470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:37 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Creating offline snapshot 2c1d8c9c-11d5-4075-a630-ffd882a58733 of volume 2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6522b71c-4d1f-496d-9dd5-c29d999c233f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:37 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153
Sep 20 16:56:37 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:37 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.442s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Deleted volume successfully.
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5c795864-a1aa-4e55-9ba9-4e76a53eab50 tempest-VolumeTypesAccessTest-1247425917 None] Lock "cinder-4074365b-106a-495a-911f-f8c4219b17d4-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:37 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153" returned: 0 in 0.535s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:37 devstack sudo[96482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 1G
Sep 20 16:56:37 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:38 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 1G" returned: 0 in 0.830s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:38 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733
Sep 20 16:56:38 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:38 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:38 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 is being set with open permissions: ugo+rw
Sep 20 16:56:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:38 devstack sudo[96520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733
Sep 20 16:56:38 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:39 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:39 devstack sudo[96523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info
Sep 20 16:56:39 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:39 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info" returned: 0 in 0.431s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:39 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info is being set with open permissions: ugo+rw
Sep 20 16:56:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:39 devstack sudo[96527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info
Sep 20 16:56:39 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:40 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.info" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6ceac2aa-84cf-4044-bf78-ba1ca04f6b21 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Create snapshot completed successfully
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "cinder-2c1d8c9c-11d5-4075-a630-ffd882a58733-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-2c1d8c9c-11d5-4075-a630-ffd882a58733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "cinder-quobyte-2c1d8c9c-11d5-4075-a630-ffd882a58733" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2c1d8c9c-11d5-4075-a630-ffd882a58733" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Deleting offline snapshot 2c1d8c9c-11d5-4075-a630-ffd882a58733 of volume 2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] snapshot_file for this snap is: volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3229a21-28c1-4b82-8c74-bb0c71af2c64]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:42 devstack sudo[96570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733
Sep 20 16:56:42 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:43 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733" returned: 0 in 0.711s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f84909b-16a2-4fb1-b3d0-09cca4677153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[61990462-8259-4ef2-8b6a-014b8388c9df]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:43 devstack sudo[96577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153
Sep 20 16:56:43 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:43 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153" returned: 0 in 0.606s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:43 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733
Sep 20 16:56:43 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:44 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733" returned: 0 in 0.670s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:44 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733
Sep 20 16:56:44 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:44 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153.2c1d8c9c-11d5-4075-a630-ffd882a58733" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2c1d8c9c-11d5-4075-a630-ffd882a58733" released by "_delete_snapshot" :: held 2.630s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" released by "delete_snapshot" :: held 2.681s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Created reservations ['70dac7c4-67fc-469f-a457-a27d52e4d959', '64df8de8-0be3-420b-ac63-a2fdb1d37386', '38166023-9f03-4ec4-852b-7e29865169fa', 'bf59c8e9-0b26-4c28-a733-f3f6c273e05a'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Delete snapshot completed successfully.
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-abcf2e9b-cb21-4b84-abc6-07a910ee4ad3 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-2c1d8c9c-11d5-4075-a630-ffd882a58733-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "cinder-2f84909b-16a2-4fb1-b3d0-09cca4677153-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-2f84909b-16a2-4fb1-b3d0-09cca4677153-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d334e-24f3-4174-8331-fe24e354d957]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:46 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153
Sep 20 16:56:46 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:56:46 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Flow 'volume_create_manager' (119e3a54-5fd6-48dd-918a-8271ed19e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071bed2-e62c-4293-bb32-004375737e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153" returned: 0 in 0.847s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071bed2-e62c-4293-bb32-004375737e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e817b692-c110-42f1-b7bb-fc32cd8b11a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77da6640f8544edae29072c940c8c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:47Z,use_quota=True,user_id='b53c56560c774c24b81b17b03cc0a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef74db0-620c-463b-a28c-a631ccc7439f),volume_type_id=8ef74db0-620c-463b-a28c-a631ccc7439f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:46 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153
Sep 20 16:56:46 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bd7f32-64c8-47b6-b43b-06b5f9cb584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bd7f32-64c8-47b6-b43b-06b5f9cb584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e94d6f-e383-4f49-a5bc-3daab402fc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:46 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 16:56:47 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2f84909b-16a2-4fb1-b3d0-09cca4677153" returned: 0 in 0.629s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-quobyte-2f84909b-16a2-4fb1-b3d0-09cca4677153" released by "delete_volume" :: held 1.645s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Created reservations ['87af2ed5-e76b-45d0-91d1-aca13e3fe02c', 'a87bf382-9d6a-4355-af32-9b0bee4fc0b6', 'd455dfec-34ad-4bcb-add0-5931b7ea86f2', '2054e7af-0ec8-4041-9c9f-2d7d569cb370'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e94d6f-e383-4f49-a5bc-3daab402fc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e817b692-c110-42f1-b7bb-fc32cd8b11a6', 'volume_name': 'volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6', 'volume_size': 1, 'image_id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78d7c779b164df53eebce8103752ca91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e77da6640f8544edae29072c940c8c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe188b20436fcfe0fa139f1d16d33fcb49bed9d5e8b639601aa9e35dc41218d893a403ede68274000d12815158117ddc8b28b0b2c033dbd142191bfd57e3a0ce', 'id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'created_at': datetime.datetime(2026, 9, 20, 14, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 56, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a034b7d0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbb7c63-c897-4970-9e1e-da2358134033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbb7c63-c897-4970-9e1e-da2358134033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8002471-97b7-42f9-9fdf-00370b371026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:47 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Volume e817b692-c110-42f1-b7bb-fc32cd8b11a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6', 'volume_size': 1, 'image_id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78d7c779b164df53eebce8103752ca91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e77da6640f8544edae29072c940c8c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe188b20436fcfe0fa139f1d16d33fcb49bed9d5e8b639601aa9e35dc41218d893a403ede68274000d12815158117ddc8b28b0b2c033dbd142191bfd57e3a0ce', 'id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'created_at': datetime.datetime(2026, 9, 20, 14, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 56, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a034b7d0>}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Trying to clone e817b692-c110-42f1-b7bb-fc32cd8b11a6 from image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:47 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:47 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 16:56:48 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Image download 0.00 MB at 0.00 MB/s
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce43173-768a-45f1-8913-6ebc6ebd6b07]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:48 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.418s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Deleted volume successfully.
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adcf9c26-f4ec-4cc4-bd2d-211a8d983078 tempest-VolumeSnapshotQuotasNegativeTestJSON-94553745 None] Lock "cinder-2f84909b-16a2-4fb1-b3d0-09cca4677153-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:48 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:48 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:48 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:48 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:48 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:49 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Temporary image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 is fetched for user b53c56560c774c24b81b17b03cc0a109. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7f1ed6-a50b-40e7-9daa-efb5acb7949c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:49 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:49 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:49 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:49 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:49 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:50 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e817b692-c110-42f1-b7bb-fc32cd8b11a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77da6640f8544edae29072c940c8c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:56:47Z,use_quota=True,user_id='b53c56560c774c24b81b17b03cc0a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef74db0-620c-463b-a28c-a631ccc7439f),volume_type_id=8ef74db0-620c-463b-a28c-a631ccc7439f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Creating volume e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:56:50 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:50 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1073741824
Sep 20 16:56:50 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:50 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1073741824" returned: 0 in 0.634s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:50 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:50 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:51 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 0 in 0.301s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Attempting download of 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}])) to volume e817b692-c110-42f1-b7bb-fc32cd8b11a6. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da3289-53b4-49fa-a3a9-98ae14bf75a0]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:51 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16
Sep 20 16:56:51 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:51 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16" returned: 0 in 0.436s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:51 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16
Sep 20 16:56:51 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:52 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16" returned: 1 in 0.517s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_i2a3mp16' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e053fd-8422-416a-8267-13c19235e3b3]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:52 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:52 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:52 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:52 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD
Sep 20 16:56:52 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:53 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 was raw, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:53 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:53 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:53 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 0 in 0.423s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e7f567e-a0f4-489c-aac1-4d0b8ba2e621_mhwd9wcxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:56:53 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Converted 0.00 MB image at 0.00 MB/s
Sep 20 16:56:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:53 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1G
Sep 20 16:56:53 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:54 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 1G" returned: 0 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:54 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50ed58-c6ca-46be-a5a0-e36e2e2cf549]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:54 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:54 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:54 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 0 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:54 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:54 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:55 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 1 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Downloaded image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}])) to volume e817b692-c110-42f1-b7bb-fc32cd8b11a6 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Temporary image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 for user b53c56560c774c24b81b17b03cc0a109 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Marking volume e817b692-c110-42f1-b7bb-fc32cd8b11a6 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Copying metadata from image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 to e817b692-c110-42f1-b7bb-fc32cd8b11a6. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Creating volume glance metadata for volume e817b692-c110-42f1-b7bb-fc32cd8b11a6 backed by image 1e7f567e-a0f4-489c-aac1-4d0b8ba2e621 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78d7c779b164df53eebce8103752ca91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8002471-97b7-42f9-9fdf-00370b371026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6', 'volume_size': 1, 'image_id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78d7c779b164df53eebce8103752ca91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e77da6640f8544edae29072c940c8c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe188b20436fcfe0fa139f1d16d33fcb49bed9d5e8b639601aa9e35dc41218d893a403ede68274000d12815158117ddc8b28b0b2c033dbd142191bfd57e3a0ce', 'id': '1e7f567e-a0f4-489c-aac1-4d0b8ba2e621', 'created_at': datetime.datetime(2026, 9, 20, 14, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 56, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e7f567e-a0f4-489c-aac1-4d0b8ba2e621/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a034b7d0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f47511-4543-4a57-847e-029c2e8ba35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:56:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Volume volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 (e817b692-c110-42f1-b7bb-fc32cd8b11a6): created successfully
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f47511-4543-4a57-847e-029c2e8ba35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:56:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Flow 'volume_create_manager' (119e3a54-5fd6-48dd-918a-8271ed19e356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:56:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e75d67c7-f015-423f-bd11-456db9cfd221 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Created volume successfully.
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Acquiring lock "cinder-e817b692-c110-42f1-b7bb-fc32cd8b11a6-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "cinder-e817b692-c110-42f1-b7bb-fc32cd8b11a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Acquiring lock "cinder-quobyte-e817b692-c110-42f1-b7bb-fc32cd8b11a6" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "cinder-quobyte-e817b692-c110-42f1-b7bb-fc32cd8b11a6" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be8716-ca07-46a6-bbf3-0989a899be3f]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:56:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:56 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:56 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:57 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 0 in 0.448s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:57 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:57 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:57 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 1 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:57 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6
Sep 20 16:56:57 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:57 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e817b692-c110-42f1-b7bb-fc32cd8b11a6" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "cinder-quobyte-e817b692-c110-42f1-b7bb-fc32cd8b11a6" released by "delete_volume" :: held 1.227s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:57 devstack cinder-volume[85945]: WARNING cinder.quota [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:57 devstack cinder-volume[85945]: WARNING cinder.quota [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Created reservations ['eacbe47c-a188-4fbc-9510-f92f9da0cf3f', 'e834a06a-ae0b-4602-9f08-45aa449062ef', '84a66e46-abd8-49d7-a736-c092528a538d', '8095acfe-c930-46ac-8604-efd5738deabb'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:58 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:58 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:56:58 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:56:58 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:56:58 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Deleted volume successfully.
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0fd17e46-6aca-4577-ac3a-3eb7ce958183 tempest-VolumeAndVolumeTypeFromImageTest-601125725 None] Lock "cinder-e817b692-c110-42f1-b7bb-fc32cd8b11a6-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:56:58 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:56:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (85688c55-c29d-441f-bbc0-a0c570828ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62b2159-d88c-46d9-8ff9-698326bd31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62b2159-d88c-46d9-8ff9-698326bd31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052927609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7abaa7-8822-431a-acc5-cec75ce07887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:06Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f790b6-ae2f-4157-bc26-86c294bcbcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f790b6-ae2f-4157-bc26-86c294bcbcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641acc4d-dbac-4e27-8d6e-1e13f4fd6668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641acc4d-dbac-4e27-8d6e-1e13f4fd6668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7abaa7-8822-431a-acc5-cec75ce07887', 'volume_name': 'volume-2d7abaa7-8822-431a-acc5-cec75ce07887', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5bd84-09b2-4f0d-85e4-b932e43361a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5bd84-09b2-4f0d-85e4-b932e43361a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f63758b-52c2-4d02-b519-5dea154e93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:06 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume 2d7abaa7-8822-431a-acc5-cec75ce07887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7abaa7-8822-431a-acc5-cec75ce07887', 'volume_size': 1}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052927609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7abaa7-8822-431a-acc5-cec75ce07887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:06Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume 2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:06 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:06 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 1073741824
Sep 20 16:57:06 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:07 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 1073741824" returned: 0 in 0.775s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:07 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=85,cinder:SELECT=69,cinder:DELETE=9,cinder:INSERT=24 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:57:07 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=72,cinder:INSERT=21,cinder:UPDATE=78,cinder:DELETE=4 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:57:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:07 devstack sudo[96790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887
Sep 20 16:57:07 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:07 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887" returned: 0 in 0.711s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f63758b-52c2-4d02-b519-5dea154e93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7abaa7-8822-431a-acc5-cec75ce07887', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f7af0a-95c0-4d1c-b6aa-c78d49f8ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Flow 'volume_create_manager' (9a90754b-e4fb-4ebb-9744-e9ed8fe23fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83884247-3bd7-4d87-9652-a328d7e2c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83884247-3bd7-4d87-9652-a328d7e2c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1167298704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf056c1-8d0e-4718-8929-b3b7f99fbc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713324494cfe406cbb3ef5caa078e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:08Z,use_quota=True,user_id='82689a0102d2433e988d81e3c0ce7391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4276a9ac-fbee-40a1-a708-c8a70690c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4276a9ac-fbee-40a1-a708-c8a70690c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61469304-d4cc-4d12-b4ee-68334abdadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61469304-d4cc-4d12-b4ee-68334abdadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf056c1-8d0e-4718-8929-b3b7f99fbc2d', 'volume_name': 'volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b2abaa-5054-40a6-8616-0069c298e1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b2abaa-5054-40a6-8616-0069c298e1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32660e3a-182d-40fe-85e0-4bf3b2f3c705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Volume daf056c1-8d0e-4718-8929-b3b7f99fbc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d', 'volume_size': 1}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1167298704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf056c1-8d0e-4718-8929-b3b7f99fbc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713324494cfe406cbb3ef5caa078e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:08Z,use_quota=True,user_id='82689a0102d2433e988d81e3c0ce7391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Creating volume daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:08 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-2d7abaa7-8822-431a-acc5-cec75ce07887 (2d7abaa7-8822-431a-acc5-cec75ce07887): created successfully
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f7af0a-95c0-4d1c-b6aa-c78d49f8ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (85688c55-c29d-441f-bbc0-a0c570828ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:08 devstack sudo[96812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d 1073741824
Sep 20 16:57:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3b87c9e2-f7a1-42e2-8669-d422a47791a2 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:08 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:08 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d 1073741824" returned: 0 in 0.797s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:09 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d
Sep 20 16:57:09 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:09 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" returned: 0 in 0.340s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.689s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32660e3a-182d-40fe-85e0-4bf3b2f3c705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291ec484-9877-4657-abf3-7ea51b304123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating offline snapshot 64593aaf-194b-419d-b79b-92872f19080e of volume 2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:57:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Volume volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d (daf056c1-8d0e-4718-8929-b3b7f99fbc2d): created successfully
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291ec484-9877-4657-abf3-7ea51b304123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Flow 'volume_create_manager' (9a90754b-e4fb-4ebb-9744-e9ed8fe23fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5b2505-5c75-434d-8d7e-b6e76e782c26]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fc07a211-9594-4b20-8edd-e9c99a1dc8cf tempest-SnapshotMetadataTestJSON-832911877 None] Created volume successfully.
Sep 20 16:57:09 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887
Sep 20 16:57:09 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:09 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887" returned: 0 in 0.474s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:09 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e 1G
Sep 20 16:57:09 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:10 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e 1G" returned: 0 in 0.587s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7abaa7-8822-431a-acc5-cec75ce07887 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:10 devstack sudo[96835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7abaa7-8822-431a-acc5-cec75ce07887 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e
Sep 20 16:57:10 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:10 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7abaa7-8822-431a-acc5-cec75ce07887 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e" returned: 0 in 0.452s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:11 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e is being set with open permissions: ugo+rw
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:11 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e
Sep 20 16:57:11 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:11 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e" returned: 0 in 0.296s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:11 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info
Sep 20 16:57:11 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:11 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info" returned: 0 in 0.282s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:11 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info is being set with open permissions: ugo+rw
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:11 devstack sudo[96847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info
Sep 20 16:57:11 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:11 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.info" returned: 0 in 0.282s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.719s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Creating offline snapshot 3508c2fc-e026-4add-a989-c1c826e1d6aa of volume daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:57:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1241793e-6d63-4c66-baa3-442905c094c0 tempest-CreateVolumesFromSnapshotTest-910997409 None] Create snapshot completed successfully
Sep 20 16:57:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a6fbda-1fac-4c38-9437-301a8e930bdb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:12 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d
Sep 20 16:57:12 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:12 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" returned: 0 in 0.490s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:12 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa 1G
Sep 20 16:57:12 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:13 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa 1G" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:13 devstack sudo[96860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa
Sep 20 16:57:13 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:13 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa" returned: 0 in 0.456s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:13 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa is being set with open permissions: ugo+rw
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:13 devstack sudo[96865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa
Sep 20 16:57:13 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (839049eb-9f9a-4684-85dc-ad098d51d206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199b014-da8c-4a58-b322-d5e8ebcd99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199b014-da8c-4a58-b322-d5e8ebcd99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712088159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9e1b16-c7c0-4f5c-85c9-2f1929b06931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:14Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b6120c-b855-489c-8c07-9fd87d3d818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b6120c-b855-489c-8c07-9fd87d3d818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df60f2f4-bf1b-4924-beb5-ef917dca094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df60f2f4-bf1b-4924-beb5-ef917dca094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9e1b16-c7c0-4f5c-85c9-2f1929b06931', 'volume_name': 'volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aae0851-4bed-4e4b-943e-dabe6ee4b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aae0851-4bed-4e4b-943e-dabe6ee4b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153358ec-4b94-483b-a3cc-9e3eaa57e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume 4e9e1b16-c7c0-4f5c-85c9-2f1929b06931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931', 'volume_size': 1}
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:13 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa" returned: 0 in 0.418s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:14 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info
Sep 20 16:57:14 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (331c5bac-3a0e-4a32-99e9-bcbde5198ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f011c7-3a38-4688-ae04-38826512b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-46dddbf9-2759-44f1-97d8-e76e2a2a0e96 req-067de4b4-d7a1-4d87-9563-d3879d5c4a75 tempest-AttachVolumeNegativeTest-210240145 None] Terminate volume connection completed successfully.
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-46dddbf9-2759-44f1-97d8-e76e2a2a0e96 req-067de4b4-d7a1-4d87-9563-d3879d5c4a75 tempest-AttachVolumeNegativeTest-210240145 None] Deleting attachment 3376733f-271a-4eb0-9c9b-97c029b1159b. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f011c7-3a38-4688-ae04-38826512b423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386576930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a94402-37a8-4a06-af75-4db5d38d0ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:14Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c16a96-b125-45d3-8e3c-451940aa934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c16a96-b125-45d3-8e3c-451940aa934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe5c565-0aac-4a0a-b65c-6a22eea0a09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe5c565-0aac-4a0a-b65c-6a22eea0a09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a94402-37a8-4a06-af75-4db5d38d0ecc', 'volume_name': 'volume-65a94402-37a8-4a06-af75-4db5d38d0ecc', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d3054a-1940-4f62-a127-bafff8257069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d3054a-1940-4f62-a127-bafff8257069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bccb1e8-0666-4515-9b80-02040dc2c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume 65a94402-37a8-4a06-af75-4db5d38d0ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a94402-37a8-4a06-af75-4db5d38d0ecc', 'volume_size': 1}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info" returned: 0 in 0.490s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:14 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info is being set with open permissions: ugo+rw
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:14 devstack sudo[96876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info
Sep 20 16:57:14 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (3f0ebf22-0d07-4c1c-89d5-6a8ebef953a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d743d-7eae-407c-9d70-c140ad38f4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d743d-7eae-407c-9d70-c140ad38f4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278000290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5262cccd-f156-4439-a9b9-8b4b2dc6dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:15Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a869d0f-8949-4d09-9772-71da10f9c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a869d0f-8949-4d09-9772-71da10f9c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc78c5cc-1553-4d39-ad22-1593cd923b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc78c5cc-1553-4d39-ad22-1593cd923b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5262cccd-f156-4439-a9b9-8b4b2dc6dcf8', 'volume_name': 'volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8da4947-317f-42d4-b697-a988d5fd9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8da4947-317f-42d4-b697-a988d5fd9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:14 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb227335-aec3-400c-b268-d0febba01cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume 5262cccd-f156-4439-a9b9-8b4b2dc6dcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8', 'volume_size': 1}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.info" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712088159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9e1b16-c7c0-4f5c-85c9-2f1929b06931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:14Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume 4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:14 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:15 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 1073741824
Sep 20 16:57:15 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b9de1f27-423d-4338-92fd-d04777d48457 tempest-SnapshotMetadataTestJSON-832911877 None] Create snapshot completed successfully
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (7e433f5b-28a5-4d35-a04a-6a13c345dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e3117-3b67-4565-a57b-e104a51a26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e3117-3b67-4565-a57b-e104a51a26bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915138946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c63f41a-b4c4-4efb-923a-5e4cdd855f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:15Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15242773-dc4b-4e3d-9c48-8fbca0869349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15242773-dc4b-4e3d-9c48-8fbca0869349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0c3ef6-2d93-4435-a2a7-2d691789e34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0c3ef6-2d93-4435-a2a7-2d691789e34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c63f41a-b4c4-4efb-923a-5e4cdd855f48', 'volume_name': 'volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af95f7ba-8331-42b6-bfef-f8f503b48f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af95f7ba-8331-42b6-bfef-f8f503b48f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99eef82d-2d9f-461f-b68b-a732db1c69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume 3c63f41a-b4c4-4efb-923a-5e4cdd855f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48', 'volume_size': 1}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:15 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 1073741824" returned: 0 in 0.838s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:16 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931
Sep 20 16:57:16 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (fc538a84-a8da-4563-ba28-65737279a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841189cb-1a30-4c11-bb2c-8ca026f6ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841189cb-1a30-4c11-bb2c-8ca026f6ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273194165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53eb934-78d0-4fa4-83f5-0e13c4376c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:16Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d39df4a-579d-4c6b-be8c-b4d3af2ba9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d39df4a-579d-4c6b-be8c-b4d3af2ba9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e4dd1c-12e8-48f0-8dd4-ebcd8c4f7693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e4dd1c-12e8-48f0-8dd4-ebcd8c4f7693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53eb934-78d0-4fa4-83f5-0e13c4376c5b', 'volume_name': 'volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6808abb-f721-4156-9596-6432c64a103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6808abb-f721-4156-9596-6432c64a103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8582b1-408d-4846-9ac2-3ca7ee9173b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume c53eb934-78d0-4fa4-83f5-0e13c4376c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b', 'volume_size': 1}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" returned: 0 in 0.440s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.915s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386576930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a94402-37a8-4a06-af75-4db5d38d0ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:14Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume 65a94402-37a8-4a06-af75-4db5d38d0ecc {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:16 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153358ec-4b94-483b-a3cc-9e3eaa57e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dba8562-4f70-46ee-af38-fc63795032b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:16 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc 1073741824
Sep 20 16:57:16 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 (4e9e1b16-c7c0-4f5c-85c9-2f1929b06931): created successfully
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dba8562-4f70-46ee-af38-fc63795032b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (839049eb-9f9a-4684-85dc-ad098d51d206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a7163bdb-88bb-424e-a7aa-45f235c5233e tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:17 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc 1073741824" returned: 0 in 0.732s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:17 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc
Sep 20 16:57:17 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:17 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "cinder-3508c2fc-e026-4add-a989-c1c826e1d6aa-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc" returned: 0 in 0.403s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278000290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5262cccd-f156-4439-a9b9-8b4b2dc6dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:15Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume 5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:17 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:17 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 1073741824
Sep 20 16:57:17 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-3508c2fc-e026-4add-a989-c1c826e1d6aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bccb1e8-0666-4515-9b80-02040dc2c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a94402-37a8-4a06-af75-4db5d38d0ecc', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e43c31-75bb-42dc-8aa5-c396bfaddf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "cinder-quobyte-3508c2fc-e026-4add-a989-c1c826e1d6aa" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-65a94402-37a8-4a06-af75-4db5d38d0ecc (65a94402-37a8-4a06-af75-4db5d38d0ecc): created successfully
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e43c31-75bb-42dc-8aa5-c396bfaddf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (331c5bac-3a0e-4a32-99e9-bcbde5198ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-3508c2fc-e026-4add-a989-c1c826e1d6aa" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Deleting offline snapshot 3508c2fc-e026-4add-a989-c1c826e1d6aa of volume daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] snapshot_file for this snap is: volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:57:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d144ff9e-8f9d-40eb-8cc9-3f077631749a tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe47f88-f8a3-48fe-acea-9f9050e6ac2e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:18 devstack sudo[96920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa
Sep 20 16:57:18 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:18 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 1073741824" returned: 0 in 0.696s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:18 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8
Sep 20 16:57:18 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:18 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa" returned: 0 in 0.645s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6a11a-28fa-4793-8a73-57301331fa19]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:18 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d
Sep 20 16:57:18 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:18 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.098s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915138946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c63f41a-b4c4-4efb-923a-5e4cdd855f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:15Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume 3c63f41a-b4c4-4efb-923a-5e4cdd855f48 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:18 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:18 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 1073741824
Sep 20 16:57:18 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb227335-aec3-400c-b268-d0febba01cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd4a626-1377-493f-bd4e-54ce416ec4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 (5262cccd-f156-4439-a9b9-8b4b2dc6dcf8): created successfully
Sep 20 16:57:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd4a626-1377-493f-bd4e-54ce416ec4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (3f0ebf22-0d07-4c1c-89d5-6a8ebef953a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c5689c63-9e6e-461a-848b-dc49387095a4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:19 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" returned: 0 in 0.552s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:19 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa
Sep 20 16:57:19 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:19 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:19 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 1073741824" returned: 0 in 0.858s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:19 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa
Sep 20 16:57:19 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:19 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48
Sep 20 16:57:19 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:20 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d.3508c2fc-e026-4add-a989-c1c826e1d6aa" returned: 0 in 0.392s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-3508c2fc-e026-4add-a989-c1c826e1d6aa" released by "_delete_snapshot" :: held 2.338s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:20 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" released by "delete_snapshot" :: held 2.395s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.740s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273194165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53eb934-78d0-4fa4-83f5-0e13c4376c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7707125aa3664f228ee2edca7497d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:16Z,use_quota=True,user_id='54cf8da8a11143409d9504daeac6b42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Creating volume c53eb934-78d0-4fa4-83f5-0e13c4376c5b {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:20 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99eef82d-2d9f-461f-b68b-a732db1c69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:20 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b 1073741824
Sep 20 16:57:20 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccc9f66-c927-4695-8c32-13c082be8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 (3c63f41a-b4c4-4efb-923a-5e4cdd855f48): created successfully
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccc9f66-c927-4695-8c32-13c082be8166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (7e433f5b-28a5-4d35-a04a-6a13c345dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-50460a11-64a1-4ce9-9d2a-41edca1f51df tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Created reservations ['51d9f30f-6df4-4a4c-acd2-6fbba5de7a1a', '31e1d8fd-add0-4003-9a85-a5413db5562d', '26b6f70f-87e5-4689-b53e-f8342537c3a5', '6d1c2696-b1da-4d17-8c1b-f824196a125e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Delete snapshot completed successfully.
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-70e5b2e0-5391-4801-9da7-83b626d35dee tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-3508c2fc-e026-4add-a989-c1c826e1d6aa-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:20 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b 1073741824" returned: 0 in 0.613s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:20 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b
Sep 20 16:57:20 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "cinder-daf056c1-8d0e-4718-8929-b3b7f99fbc2d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-daf056c1-8d0e-4718-8929-b3b7f99fbc2d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8103a858-dde6-406a-b706-ed090adfb01f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:21 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" returned: 0 in 0.472s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8582b1-408d-4846-9ac2-3ca7ee9173b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cca8d09-acfa-47bf-a52a-da98922176ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Volume volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b (c53eb934-78d0-4fa4-83f5-0e13c4376c5b): created successfully
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cca8d09-acfa-47bf-a52a-da98922176ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Flow 'volume_create_manager' (fc538a84-a8da-4563-ba28-65737279a28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0a8d2da3-a0f9-4637-b9b8-d54f0e19d691 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created volume successfully.
Sep 20 16:57:21 devstack sudo[96967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d
Sep 20 16:57:21 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:21 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:21 devstack sudo[96973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d
Sep 20 16:57:21 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:22 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-c53eb934-78d0-4fa4-83f5-0e13c4376c5b-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-c53eb934-78d0-4fa4-83f5-0e13c4376c5b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-quobyte-daf056c1-8d0e-4718-8929-b3b7f99fbc2d" released by "delete_volume" :: held 0.936s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Created reservations ['bf915a68-ae0a-41af-9a97-3239c81e076b', 'c38591db-5263-4cf7-9a3c-262ffd881814', 'ab033c5f-c8df-4004-b8be-08b4cedf36e2', 'e7e98fb0-7399-4053-b268-c4af26475559'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a783ce-0c5f-4fac-85f4-9340c3826d9c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:22 devstack sudo[96976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b
Sep 20 16:57:22 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:22 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:22 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:22 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.356s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Deleted volume successfully.
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cbdf3af5-72c5-4dcb-9af5-b3fee5ad416f tempest-SnapshotMetadataTestJSON-832911877 None] Lock "cinder-daf056c1-8d0e-4718-8929-b3b7f99fbc2d-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:22 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" returned: 0 in 0.592s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:22 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b
Sep 20 16:57:22 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:23 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" returned: 0 in 0.408s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-c53eb934-78d0-4fa4-83f5-0e13c4376c5b" released by "delete_volume" :: held 1.100s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['df92faa1-4db8-4953-a1dc-d21c73c209e3', 'bfdb2e2f-b2bd-4bf4-8401-0f122bd45521', 'a9fa0a76-fdd3-4c46-8550-16d0f39cf518', 'c6bec4fe-ec14-42ba-a9ee-b5a26ca8e4ff'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:23 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:23 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:23 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b62befc-dbe5-4300-b9ab-dce90425c21a tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-c53eb934-78d0-4fa4-83f5-0e13c4376c5b-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-3c63f41a-b4c4-4efb-923a-5e4cdd855f48-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-3c63f41a-b4c4-4efb-923a-5e4cdd855f48-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b7813-8abd-494c-9438-9ab10adb8e53]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:24 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48
Sep 20 16:57:24 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:24 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" returned: 0 in 0.449s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:25 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48
Sep 20 16:57:25 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:25 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-3c63f41a-b4c4-4efb-923a-5e4cdd855f48" released by "delete_volume" :: held 0.812s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['aabbec8f-8d19-4420-95ff-073fa22d2290', 'f15f5f73-5eb4-41ee-88c6-787393b856c2', '7a7bcbdf-609e-480e-b680-4b9fa22296bc', '7e7aa8da-649b-445c-bb0d-f889055213b4'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:25 devstack sudo[96998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:25 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa0891-5285-4a99-824f-5a9d619418cc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:26 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.576s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2cda901d-7f98-4bfc-bd77-905183379c12 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-3c63f41a-b4c4-4efb-923a-5e4cdd855f48-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:26 devstack sudo[97004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8
Sep 20 16:57:26 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:26 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:26 devstack sudo[97009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8
Sep 20 16:57:26 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:26 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8" released by "delete_volume" :: held 1.024s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['4d7e1cae-5aba-45f8-b1f7-02e4eb43c2ba', 'c9998958-84cf-4d70-82b5-a6e4b650f9c7', 'c5e78ec1-7edf-4cb0-9a96-8810a2ec45bc', 'fae565b2-d205-48b8-a204-531bd722d179'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:27 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:27 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:27 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4dc6347f-748d-4a5b-b14c-f64a342e86f4 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-5262cccd-f156-4439-a9b9-8b4b2dc6dcf8-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-65a94402-37a8-4a06-af75-4db5d38d0ecc-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-65a94402-37a8-4a06-af75-4db5d38d0ecc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-65a94402-37a8-4a06-af75-4db5d38d0ecc" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-65a94402-37a8-4a06-af75-4db5d38d0ecc" acquired by "delete_volume" :: waited 0.031s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd00eaa-3c78-4796-b894-94f3cf06b623]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:28 devstack sudo[97032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc
Sep 20 16:57:28 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:29 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc" returned: 0 in 0.682s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:29 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc
Sep 20 16:57:29 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:29 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-65a94402-37a8-4a06-af75-4db5d38d0ecc" returned: 0 in 0.355s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-65a94402-37a8-4a06-af75-4db5d38d0ecc" released by "delete_volume" :: held 1.148s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['34ad29f3-e505-44e2-8ef8-6046ef2b1ddb', '49896881-5a47-401a-a2d1-07f8346bbc18', '5e290c1b-347b-4a5b-9c08-e684b19db233', 'a3a969ab-7044-449c-9ce0-871ac5d38efc'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:29 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:29 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:30 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.475s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e4883a5e-270c-485f-b448-1de35aa79b97 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-65a94402-37a8-4a06-af75-4db5d38d0ecc-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5202d9cd-ea56-4567-8f18-c3d6a5917e24]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:30 devstack sudo[97060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931
Sep 20 16:57:30 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:31 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" returned: 0 in 0.569s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:31 devstack sudo[97072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931
Sep 20 16:57:31 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:31 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" returned: 0 in 0.620s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931" released by "delete_volume" :: held 1.251s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['5b71e733-60ce-4bfa-8256-221097dda7ea', 'cdd0b7d6-8622-41c4-b13f-599644c52415', '66212130-fb2d-4698-9af8-3ed4215617fe', 'bb83f94d-71f1-4906-9f83-0a2f5ec1f9ae'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:32 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:32 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:32 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.498s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-54ef080f-29e7-4be6-8bb0-67a15926045d tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-4e9e1b16-c7c0-4f5c-85c9-2f1929b06931-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-64593aaf-194b-419d-b79b-92872f19080e-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-64593aaf-194b-419d-b79b-92872f19080e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-64593aaf-194b-419d-b79b-92872f19080e" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-64593aaf-194b-419d-b79b-92872f19080e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleting offline snapshot 64593aaf-194b-419d-b79b-92872f19080e of volume 2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] snapshot_file for this snap is: volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f892f07c-4a0a-4b2c-89d6-0f78baeb7197]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:33 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e
Sep 20 16:57:33 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:34 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e" returned: 0 in 0.870s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d7abaa7-8822-431a-acc5-cec75ce07887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f44c708-694c-4dbe-a601-ebb50412dbc8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:34 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887
Sep 20 16:57:34 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:34 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887" returned: 0 in 0.468s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:34 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e
Sep 20 16:57:34 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:35 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e" returned: 0 in 0.640s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:35 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e
Sep 20 16:57:35 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:35 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887.64593aaf-194b-419d-b79b-92872f19080e" returned: 0 in 0.442s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-64593aaf-194b-419d-b79b-92872f19080e" released by "_delete_snapshot" :: held 2.720s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" released by "delete_snapshot" :: held 2.772s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['d1467726-95cc-4cb2-bb17-57a8bc04f112', 'ca5464f5-6566-401a-a35e-d5a5d7bdc1a2', 'ea5eeed3-9196-407b-bfd2-5d7c7df7785c', '76f2f5e8-c20f-45f3-b4bd-8e7f9365563d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Delete snapshot completed successfully.
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-96d637d4-bb50-4e63-9607-db118eb92e7f tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-64593aaf-194b-419d-b79b-92872f19080e-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-2d7abaa7-8822-431a-acc5-cec75ce07887-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-2d7abaa7-8822-431a-acc5-cec75ce07887-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" acquired by "delete_volume" :: waited 0.052s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2fc7b-3748-438d-8d08-f6cb93c82213]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:37 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887
Sep 20 16:57:37 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (9ff15c19-35bb-4078-801d-78199210b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5374243-0798-47b6-b79f-8d5ddcbbaa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5374243-0798-47b6-b79f-8d5ddcbbaa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1635261633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bc91b8-abf0-4bad-bdde-cd146b56a479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:38Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2f5339-769b-4b72-9cdf-1416169e3adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:38 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2f5339-769b-4b72-9cdf-1416169e3adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4d4c68-97ae-4a3c-9984-46420103b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4d4c68-97ae-4a3c-9984-46420103b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bc91b8-abf0-4bad-bdde-cd146b56a479', 'volume_name': 'volume-40bc91b8-abf0-4bad-bdde-cd146b56a479', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b102ce-2f71-42c9-a5f4-8ee7a8f43603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b102ce-2f71-42c9-a5f4-8ee7a8f43603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea9f51f-0da3-4624-9525-f1bea2e08322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:38 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Volume 40bc91b8-abf0-4bad-bdde-cd146b56a479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bc91b8-abf0-4bad-bdde-cd146b56a479', 'volume_size': 1}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1635261633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bc91b8-abf0-4bad-bdde-cd146b56a479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:38Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Creating volume 40bc91b8-abf0-4bad-bdde-cd146b56a479 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:38 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887" returned: 0 in 1.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:38 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 1073741824
Sep 20 16:57:38 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:38 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887
Sep 20 16:57:38 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:39 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2d7abaa7-8822-431a-acc5-cec75ce07887" returned: 0 in 1.207s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-quobyte-2d7abaa7-8822-431a-acc5-cec75ce07887" released by "delete_volume" :: held 2.791s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:40 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 1073741824" returned: 0 in 1.607s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Created reservations ['d96597f5-6a9a-487f-9b86-4916e837c6c3', 'ed546c12-d63f-4f1b-8954-8833e935b9bd', '395e2d52-dc42-4be0-b75f-31270de05fdd', '6fec0fca-accb-40b9-9605-0899d59a609e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:40 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479
Sep 20 16:57:40 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:40 devstack sudo[97265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:40 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:40 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479" returned: 0 in 0.547s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea9f51f-0da3-4624-9525-f1bea2e08322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bc91b8-abf0-4bad-bdde-cd146b56a479', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97d8cdc-31f7-404a-956f-baf3dc790706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:40 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Volume volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 (40bc91b8-abf0-4bad-bdde-cd146b56a479): created successfully
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97d8cdc-31f7-404a-956f-baf3dc790706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (9ff15c19-35bb-4078-801d-78199210b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6f0e2cb3-711d-4c6f-aa89-7c4225337435 tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Flow 'volume_create_manager' (9947ce14-7b93-4cb6-a647-8beaa3ce2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7e7262-12ff-40a1-a2f9-f360e9d7a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:41 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7e7262-12ff-40a1-a2f9-f360e9d7a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-803089975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97b8a56-e5cb-47aa-a344-185fe0e00392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e139af4911d4da88d8ad2ba1ab54631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:41Z,use_quota=True,user_id='38e4a2fd80c549089e6d4e905e8d2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984a397-f9c1-4b94-94c7-aab8084dae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984a397-f9c1-4b94-94c7-aab8084dae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1195c809-7ea2-446b-96cd-1cf7ae96b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1195c809-7ea2-446b-96cd-1cf7ae96b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97b8a56-e5cb-47aa-a344-185fe0e00392', 'volume_name': 'volume-e97b8a56-e5cb-47aa-a344-185fe0e00392', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23031917-6dc7-4536-9a8c-dd51ec9c986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23031917-6dc7-4536-9a8c-dd51ec9c986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24b3c5b-5b25-4d49-b3e8-1cc920ac18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:41 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Volume e97b8a56-e5cb-47aa-a344-185fe0e00392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97b8a56-e5cb-47aa-a344-185fe0e00392', 'volume_size': 1}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-803089975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97b8a56-e5cb-47aa-a344-185fe0e00392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e139af4911d4da88d8ad2ba1ab54631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:41Z,use_quota=True,user_id='38e4a2fd80c549089e6d4e905e8d2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Creating volume e97b8a56-e5cb-47aa-a344-185fe0e00392 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:41 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:41 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 1073741824
Sep 20 16:57:41 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e74ebf2-a90a-4ae0-a311-c82b25be5654 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479" by "attach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 1.055s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Deleted volume successfully.
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e74ebf2-a90a-4ae0-a311-c82b25be5654 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479" acquired by "attach_volume" :: waited 0.117s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-41b364a3-bba3-460c-a94c-940530923322 tempest-CreateVolumesFromSnapshotTest-910997409 None] Lock "cinder-2d7abaa7-8822-431a-acc5-cec75ce07887-delete_volume" released by "delete_volume" :: held 4.886s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7e74ebf2-a90a-4ae0-a311-c82b25be5654 tempest-VolumesActionsTest-1966484042 None] Attaching volume 40bc91b8-abf0-4bad-bdde-cd146b56a479 to instance 5ae7804f-27cc-480c-8aca-fad97ebf6401 at mountpoint /dev/vdb on host None.
Sep 20 16:57:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7e74ebf2-a90a-4ae0-a311-c82b25be5654 tempest-VolumesActionsTest-1966484042 None] Attach volume completed successfully.
Sep 20 16:57:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7e74ebf2-a90a-4ae0-a311-c82b25be5654 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479" released by "attach_volume" :: held 0.255s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:42 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 1073741824" returned: 0 in 1.136s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:42 devstack sudo[97279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392
Sep 20 16:57:42 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:43 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392" returned: 0 in 0.719s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24b3c5b-5b25-4d49-b3e8-1cc920ac18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97b8a56-e5cb-47aa-a344-185fe0e00392', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc5e00-8917-465b-ae06-31567dbdc83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Volume volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 (e97b8a56-e5cb-47aa-a344-185fe0e00392): created successfully
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc5e00-8917-465b-ae06-31567dbdc83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Flow 'volume_create_manager' (9947ce14-7b93-4cb6-a647-8beaa3ce2985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-304b3f53-369f-4001-ba20-41045d204ea8 tempest-VolumesTransfersTest-2121097518 None] Created volume successfully.
Sep 20 16:57:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Terminate volume connection completed successfully.
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" by "detach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Detaching volume 40bc91b8-abf0-4bad-bdde-cd146b56a479 from instance 5ae7804f-27cc-480c-8aca-fad97ebf6401.
Sep 20 16:57:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Detach volume completed successfully.
Sep 20 16:57:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a2f7cfeb-50a4-4eb3-a6a3-7b470242f4d3 tempest-VolumesActionsTest-603659013 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49588a34-aaaa-4411-8117-21cfa64eac14 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" by "detach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49588a34-aaaa-4411-8117-21cfa64eac14 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-49588a34-aaaa-4411-8117-21cfa64eac14 tempest-VolumesActionsTest-1966484042 None] Volume detach called, but volume not attached.
Sep 20 16:57:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49588a34-aaaa-4411-8117-21cfa64eac14 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-quobyte-40bc91b8-abf0-4bad-bdde-cd146b56a479" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-quobyte-40bc91b8-abf0-4bad-bdde-cd146b56a479" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22b135-6220-44ce-b9f1-f35ed5b991e1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:45 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479
Sep 20 16:57:45 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:46 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479" returned: 0 in 0.852s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:46 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479
Sep 20 16:57:46 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4e017f1c-14d9-41d9-b223-6bc9ded62cdd tempest-VolumesTransfersTest-2019047248 None] Transfer volume completed successfully.
Sep 20 16:57:46 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-40bc91b8-abf0-4bad-bdde-cd146b56a479" returned: 0 in 0.495s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-quobyte-40bc91b8-abf0-4bad-bdde-cd146b56a479" released by "delete_volume" :: held 1.485s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Created reservations ['91d559a2-e9f4-4fc4-abbe-0ff86d75c267', '41d45ef5-dc33-4bd1-a7ce-91458017dbf7', 'a6a289d3-70bf-448a-ba87-c158945ddcb3', 'f678839d-5eed-4379-ba7d-bbefe3cfe97e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:47 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:47 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:47 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "cinder-e97b8a56-e5cb-47aa-a344-185fe0e00392-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.876s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:47 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Deleted volume successfully.
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-e97b8a56-e5cb-47aa-a344-185fe0e00392-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b0935889-c52a-4207-b1ef-d8fd5feedd75 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-40bc91b8-abf0-4bad-bdde-cd146b56a479-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "cinder-quobyte-e97b8a56-e5cb-47aa-a344-185fe0e00392" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-quobyte-e97b8a56-e5cb-47aa-a344-185fe0e00392" acquired by "delete_volume" :: waited 0.043s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9788b-4b4a-4f3e-b767-c6f17a10e7ab]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:48 devstack sudo[97363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392
Sep 20 16:57:48 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:49 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392" returned: 0 in 0.769s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:49 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392
Sep 20 16:57:49 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:49 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e97b8a56-e5cb-47aa-a344-185fe0e00392" returned: 0 in 0.518s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-quobyte-e97b8a56-e5cb-47aa-a344-185fe0e00392" released by "delete_volume" :: held 1.368s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Created reservations ['f16e2395-56d0-4cbf-b68e-2ce67ced40d4', 'c54a4763-647d-41fe-b450-349184806d42', '265b3ed3-8be9-4933-b4c2-5177701be258', '96842979-cfff-44cf-8be3-15f58c3385e1'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:49 devstack sudo[97394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:49 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:50 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Deleted volume successfully.
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-02e7cc04-e418-43d0-9a73-2bb826e3f857 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-e97b8a56-e5cb-47aa-a344-185fe0e00392-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Flow 'volume_create_manager' (c9158d80-d394-432c-81af-9c02d53edd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568a1bb9-de09-4a16-8110-e8405f229a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568a1bb9-de09-4a16-8110-e8405f229a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-473207517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37360b84-c4a7-435f-a33c-3e9530edc4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e139af4911d4da88d8ad2ba1ab54631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:51Z,use_quota=True,user_id='38e4a2fd80c549089e6d4e905e8d2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c568e1ee-a5cb-4506-9ea5-8cc3a9ccad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c568e1ee-a5cb-4506-9ea5-8cc3a9ccad87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf5a85c-b311-41d0-8028-bbec0a5dea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf5a85c-b311-41d0-8028-bbec0a5dea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37360b84-c4a7-435f-a33c-3e9530edc4d4', 'volume_name': 'volume-37360b84-c4a7-435f-a33c-3e9530edc4d4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0dc62-9ace-4c90-a4c4-050bd69ac95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0dc62-9ace-4c90-a4c4-050bd69ac95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9fbb5f-4c29-496d-98da-b403d7226044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Volume 37360b84-c4a7-435f-a33c-3e9530edc4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37360b84-c4a7-435f-a33c-3e9530edc4d4', 'volume_size': 1}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-473207517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37360b84-c4a7-435f-a33c-3e9530edc4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e139af4911d4da88d8ad2ba1ab54631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:51Z,use_quota=True,user_id='38e4a2fd80c549089e6d4e905e8d2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Creating volume 37360b84-c4a7-435f-a33c-3e9530edc4d4 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:51 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:51 devstack sudo[97399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 1073741824
Sep 20 16:57:51 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:51 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 1073741824" returned: 0 in 0.707s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:51 devstack sudo[97406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4
Sep 20 16:57:51 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:52 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4" returned: 0 in 0.383s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9fbb5f-4c29-496d-98da-b403d7226044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37360b84-c4a7-435f-a33c-3e9530edc4d4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20891cc-a120-4d18-b374-6b059706f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Volume volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 (37360b84-c4a7-435f-a33c-3e9530edc4d4): created successfully
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20891cc-a120-4d18-b374-6b059706f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Flow 'volume_create_manager' (c9158d80-d394-432c-81af-9c02d53edd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-29df0720-d4a8-44d5-87bf-b40000673c0b tempest-VolumesTransfersTest-2121097518 None] Created volume successfully.
Sep 20 16:57:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (f62f7b53-ed46-4063-b63f-42f33fb8c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92aa161-2a93-40c8-b3af-e97676ba2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92aa161-2a93-40c8-b3af-e97676ba2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771542794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:53Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5fdef5-29da-4dbe-9e4e-065ae097637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5fdef5-29da-4dbe-9e4e-065ae097637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686ecfad-a134-441d-b93c-0a3cd6890d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686ecfad-a134-441d-b93c-0a3cd6890d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e', 'volume_name': 'volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07d5759-96b0-4b3f-95d1-d5207da152e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07d5759-96b0-4b3f-95d1-d5207da152e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646817ea-918f-481f-8d8e-eab7d637bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Volume 7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e', 'volume_size': 1}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771542794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:53Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Creating volume 7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:53 devstack sudo[97410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e 1073741824
Sep 20 16:57:53 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "cinder-37360b84-c4a7-435f-a33c-3e9530edc4d4-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-37360b84-c4a7-435f-a33c-3e9530edc4d4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "cinder-quobyte-37360b84-c4a7-435f-a33c-3e9530edc4d4" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-quobyte-37360b84-c4a7-435f-a33c-3e9530edc4d4" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc13c265-14aa-4f1a-8e93-3430abfe70c3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:53 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4
Sep 20 16:57:53 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:53 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e 1073741824" returned: 0 in 0.810s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:54 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e
Sep 20 16:57:54 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:54 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4" returned: 0 in 0.531s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:54 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4
Sep 20 16:57:54 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:54 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" returned: 0 in 0.305s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646817ea-918f-481f-8d8e-eab7d637bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd448a95-d973-409b-b709-7b9a9cefe031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Volume volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e (7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e): created successfully
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd448a95-d973-409b-b709-7b9a9cefe031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (f62f7b53-ed46-4063-b63f-42f33fb8c485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ac6db0ae-fe67-4499-96da-b133941e19c1 tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:57:54 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-37360b84-c4a7-435f-a33c-3e9530edc4d4" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-quobyte-37360b84-c4a7-435f-a33c-3e9530edc4d4" released by "delete_volume" :: held 0.850s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Created reservations ['2065c61d-0a4e-4986-bfaf-185952dbaab0', 'e5320c1f-e5d6-4712-ab47-77871824b309', '1ce6d7a3-3a4c-4adc-8956-f805f8f55fc4', 'ca2fb75b-df03-4d36-a754-252ea5c01343'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:54 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:54 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:55 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.369s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Deleted volume successfully.
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-44367f8e-1533-44de-99bc-eb572eb33c71 tempest-VolumesTransfersTest-683766293 None] Lock "cinder-37360b84-c4a7-435f-a33c-3e9530edc4d4-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "cinder-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-quobyte-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd184289-8b57-44e6-885d-eedd166a9932]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:55 devstack sudo[97451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e
Sep 20 16:57:55 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:55 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" returned: 0 in 0.508s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:55 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e
Sep 20 16:57:55 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:56 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e" released by "delete_volume" :: held 0.866s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Created reservations ['3b08b9c5-a5b3-4667-957d-69e24e25be1d', 'b792b646-6d73-45d8-88c7-f9ebba79ebf4', 'f6b3e4e8-0fb9-40ff-ac2b-2a52a332e5df', '34ce7255-ad0d-497a-a443-8cd104b5ebe7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:56 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:56 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:56 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.357s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Deleted volume successfully.
Sep 20 16:57:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-08672a46-0c4e-4c6d-aa8a-111416bf312c tempest-VolumesActionsTest-603659013 None] Lock "cinder-7fd00aca-46b3-4ebb-b2ba-6e8c13bdcf0e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (86f1bece-5908-4dbe-8dc8-4dddb4189c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd0198b-0857-457f-af68-8e0218088065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd0198b-0857-457f-af68-8e0218088065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819999761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c49eae-135b-49a3-b23d-c72009986053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:57Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ee041-f6bd-4cd6-962e-26e9341e8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ee041-f6bd-4cd6-962e-26e9341e8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f241b9d5-70b0-41ae-a8b5-c8adf2827c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f241b9d5-70b0-41ae-a8b5-c8adf2827c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c49eae-135b-49a3-b23d-c72009986053', 'volume_name': 'volume-32c49eae-135b-49a3-b23d-c72009986053', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd56e9a5-467d-4f55-9e3d-c3631f91ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd56e9a5-467d-4f55-9e3d-c3631f91ac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e8074c-eb0c-4ac4-85f3-32d4c0bcb742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:57 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Volume 32c49eae-135b-49a3-b23d-c72009986053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c49eae-135b-49a3-b23d-c72009986053', 'volume_size': 1}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819999761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c49eae-135b-49a3-b23d-c72009986053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:57:57Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Creating volume 32c49eae-135b-49a3-b23d-c72009986053 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:57:57 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:57 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 1073741824
Sep 20 16:57:57 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:57 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 1073741824" returned: 0 in 0.551s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:57 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053
Sep 20 16:57:57 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:58 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e8074c-eb0c-4ac4-85f3-32d4c0bcb742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c49eae-135b-49a3-b23d-c72009986053', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c71427-00c5-470c-929f-ab4a5ba55919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:57:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Volume volume-32c49eae-135b-49a3-b23d-c72009986053 (32c49eae-135b-49a3-b23d-c72009986053): created successfully
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c71427-00c5-470c-929f-ab4a5ba55919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (86f1bece-5908-4dbe-8dc8-4dddb4189c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8518a581-ae84-476d-a042-96feac0306f1 tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:57:58 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:57:58 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:57:58 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:57:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-32c49eae-135b-49a3-b23d-c72009986053-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "cinder-32c49eae-135b-49a3-b23d-c72009986053-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-quobyte-32c49eae-135b-49a3-b23d-c72009986053" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-32c49eae-135b-49a3-b23d-c72009986053" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d830a391-64d7-4e4d-979d-885945581af0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:57:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:57:59 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053
Sep 20 16:57:59 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:00 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053" returned: 0 in 0.483s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:00 devstack sudo[97486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053
Sep 20 16:58:00 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:00 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-32c49eae-135b-49a3-b23d-c72009986053" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-32c49eae-135b-49a3-b23d-c72009986053" released by "delete_volume" :: held 0.831s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Created reservations ['c861d8a8-b72c-4dfc-8c04-d14b979b19dc', '1a56fcc7-f59f-4c2b-8b69-550f8d104e88', 'b14c3aae-be7e-4834-963a-6b78315f6f93', '2488a099-1680-4f83-8aeb-6cbd2f9dfbdf'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:00 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:00 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:00 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.302s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Deleted volume successfully.
Sep 20 16:58:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee396a3a-2aa8-4ca2-a078-29f992770c93 tempest-VolumesActionsTest-603659013 None] Lock "cinder-32c49eae-135b-49a3-b23d-c72009986053-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (bcc6628a-45f1-44af-ad05-69e9a77e7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decd4a1-29a3-45c0-bcdc-3ee5943ee5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decd4a1-29a3-45c0-bcdc-3ee5943ee5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1354516080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d416d-0b89-47ec-81f1-bfbb829451cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:03Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213697c1-c79d-4b69-b968-e13766c53c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213697c1-c79d-4b69-b968-e13766c53c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f37ccea-4d8f-4921-8bfa-be24cdec426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f37ccea-4d8f-4921-8bfa-be24cdec426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8d416d-0b89-47ec-81f1-bfbb829451cc', 'volume_name': 'volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae682dc-c250-43ee-ad8b-f04679680f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae682dc-c250-43ee-ad8b-f04679680f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327a28c5-aef5-4fc2-80c2-3a989286eff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:03 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Volume ba8d416d-0b89-47ec-81f1-bfbb829451cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc', 'volume_size': 1}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1354516080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d416d-0b89-47ec-81f1-bfbb829451cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:03Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Creating volume ba8d416d-0b89-47ec-81f1-bfbb829451cc {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:03 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:03 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc 1073741824
Sep 20 16:58:03 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:03 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc 1073741824" returned: 0 in 0.714s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:03 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc
Sep 20 16:58:03 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:04 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327a28c5-aef5-4fc2-80c2-3a989286eff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ac1282-16c0-4984-8fe8-c1a6124f5165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:04 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Volume volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc (ba8d416d-0b89-47ec-81f1-bfbb829451cc): created successfully
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ac1282-16c0-4984-8fe8-c1a6124f5165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (bcc6628a-45f1-44af-ad05-69e9a77e7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f8380e86-bfe0-4edf-84ae-f05200466eca tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (8159fe75-2a64-4236-809a-a21b5ba96380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06959e6a-d5c4-4256-a2d8-8025325cb95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06959e6a-d5c4-4256-a2d8-8025325cb95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1124783208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:05Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5243ea40-8fcd-4c88-b2f8-5f5d367ba41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5243ea40-8fcd-4c88-b2f8-5f5d367ba41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f38a43f-7d2d-4cfc-93e7-2f68cfc47da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f38a43f-7d2d-4cfc-93e7-2f68cfc47da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a', 'volume_name': 'volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0d821-6b7a-4a6b-aee9-318e47bd23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0d821-6b7a-4a6b-aee9-318e47bd23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19310c5a-eb83-4651-8d7e-50814f38d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Volume f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a', 'volume_size': 1}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1124783208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:05Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Creating volume f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:05 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-ba8d416d-0b89-47ec-81f1-bfbb829451cc-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "cinder-ba8d416d-0b89-47ec-81f1-bfbb829451cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:05 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a 1073741824
Sep 20 16:58:05 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-quobyte-ba8d416d-0b89-47ec-81f1-bfbb829451cc" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-ba8d416d-0b89-47ec-81f1-bfbb829451cc" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b9818a-1544-4cf0-91a6-4917e3c873b0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:05 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc
Sep 20 16:58:05 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:05 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a 1073741824" returned: 0 in 0.595s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:05 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc" returned: 0 in 0.480s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:05 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc
Sep 20 16:58:05 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:05 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a
Sep 20 16:58:05 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:06 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ba8d416d-0b89-47ec-81f1-bfbb829451cc" returned: 0 in 0.323s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-ba8d416d-0b89-47ec-81f1-bfbb829451cc" released by "delete_volume" :: held 0.869s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:06 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" returned: 0 in 0.384s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19310c5a-eb83-4651-8d7e-50814f38d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e511e6-e954-41e8-a114-0dbfbecd3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Created reservations ['31804f26-9aa0-4b42-b183-3dc8ff119bb6', '860a4a61-82a2-436a-a24a-a85e295af818', '89a40e26-297a-4447-9162-7501b0aaac67', '006d4560-7009-4a2d-adc6-21b05f082c70'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:06 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Volume volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a (f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a): created successfully
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e511e6-e954-41e8-a114-0dbfbecd3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (8159fe75-2a64-4236-809a-a21b5ba96380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c99732db-1bc1-4b8b-ae1b-252b976980f9 tempest-AttachVolumeNegativeTest-210240145 None] Created volume successfully.
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:06 devstack sudo[97524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:06 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:06 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.308s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Deleted volume successfully.
Sep 20 16:58:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9557b0b7-b9b6-4ed8-af3d-652c6f4b8436 tempest-VolumesActionsTest-603659013 None] Lock "cinder-ba8d416d-0b89-47ec-81f1-bfbb829451cc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=131,cinder:INSERT=34,cinder:UPDATE=160,cinder:DELETE=16 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=108,cinder:UPDATE=167,cinder:INSERT=44,cinder:DELETE=13 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (b8f22501-34f7-4af3-99ea-77d9c197ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a79621e-cc9f-4c0a-bff9-6f5e1fd4e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a79621e-cc9f-4c0a-bff9-6f5e1fd4e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-207628003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f353b7-e7a7-44a0-8a89-3b0bd22d9940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:08Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732aa72f-8c3e-4077-a4f2-8e3980cf08b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732aa72f-8c3e-4077-a4f2-8e3980cf08b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0087bd-4eff-4ae3-b842-d71fe8e51115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0087bd-4eff-4ae3-b842-d71fe8e51115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f353b7-e7a7-44a0-8a89-3b0bd22d9940', 'volume_name': 'volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f073aaa-be3a-4c13-a069-5d23acc61efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f073aaa-be3a-4c13-a069-5d23acc61efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd691b7b-dfea-4238-b88e-a70647e0c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Volume b7f353b7-e7a7-44a0-8a89-3b0bd22d9940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940', 'volume_size': 1}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-207628003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f353b7-e7a7-44a0-8a89-3b0bd22d9940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:08Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Creating volume b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:08 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:08 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 1073741824
Sep 20 16:58:08 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:09 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 1073741824" returned: 0 in 0.721s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:09 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940
Sep 20 16:58:09 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:09 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.383s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd691b7b-dfea-4238-b88e-a70647e0c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a68290-cafe-4c8e-ba5c-b405fcebbf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233477e-f9b0-420e-9ce6-dc4cc05c8426]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Volume volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 (b7f353b7-e7a7-44a0-8a89-3b0bd22d9940): created successfully
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a68290-cafe-4c8e-ba5c-b405fcebbf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (b8f22501-34f7-4af3-99ea-77d9c197ec94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75c7bc0c-100b-410c-90ea-a3d79f7527cd tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:58:09 devstack sudo[97546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a
Sep 20 16:58:09 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:10 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" returned: 0 in 0.574s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8e870f3-fbd5-4e17-8237-1df8d708bf82', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:58:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-af7caa98-b713-4b19-a3d7-d268679f52f7 req-de54c1b8-34a0-43a3-936f-1e5e49f8f2f0 tempest-AttachVolumeNegativeTest-210240145 None] attachment_update completed successfully.
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "cinder-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Acquiring lock "cinder-quobyte-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014e7e2-9d29-4b69-aef3-7178c7b2c248]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:10 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940
Sep 20 16:58:10 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:11 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" returned: 0 in 0.754s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:11 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940
Sep 20 16:58:11 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:11 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" returned: 0 in 0.418s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "cinder-quobyte-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940" released by "delete_volume" :: held 1.253s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:11 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Created reservations ['9c16fde6-5cb6-4787-af5a-994008122dac', 'fdc30e3b-b9b5-4e8a-af35-90c52549506f', 'debc6d85-5d5a-4e41-a0e1-7979a4f8dfcb', 'a9fbad2c-8ea6-4d25-944c-2f23e821750b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:12 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:12 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:12 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.342s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Deleted volume successfully.
Sep 20 16:58:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6a1c65a0-4f91-4a97-9eb4-9a57283e793e tempest-VolumesActionsTest-603659013 None] Lock "cinder-b7f353b7-e7a7-44a0-8a89-3b0bd22d9940-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-cf206978-0e0d-4f0c-9720-ea781a9bab32 req-a0cc843d-fc83-42bf-96be-5fd18ba97d95 tempest-AttachVolumeNegativeTest-210240145 None] Terminate volume connection completed successfully.
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-cf206978-0e0d-4f0c-9720-ea781a9bab32 req-a0cc843d-fc83-42bf-96be-5fd18ba97d95 tempest-AttachVolumeNegativeTest-210240145 None] Deleting attachment f8e870f3-fbd5-4e17-8237-1df8d708bf82. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (e9c4c7ca-5473-4b35-afa0-fdacd9f323f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ec44b8-834a-484f-a9ae-04e31c883a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ec44b8-834a-484f-a9ae-04e31c883a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33325765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919e6f73-8dc9-48b7-aede-12eabc213892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:14Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f0ce7a-2d22-4163-9fb4-fc19548ba6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f0ce7a-2d22-4163-9fb4-fc19548ba6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66c7cbd-07f6-4631-988d-2c0db70d4917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66c7cbd-07f6-4631-988d-2c0db70d4917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919e6f73-8dc9-48b7-aede-12eabc213892', 'volume_name': 'volume-919e6f73-8dc9-48b7-aede-12eabc213892', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c1b591-daf3-46c2-a5d3-75d77364d790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c1b591-daf3-46c2-a5d3-75d77364d790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fc64c8-2047-4ce1-8d86-d67e6ded3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Volume 919e6f73-8dc9-48b7-aede-12eabc213892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919e6f73-8dc9-48b7-aede-12eabc213892', 'volume_size': 1}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33325765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919e6f73-8dc9-48b7-aede-12eabc213892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d91237d0f4160b2b7a3e70e3b46d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:14Z,use_quota=True,user_id='5552223d2e5d4d949f6839dfc0006df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Creating volume 919e6f73-8dc9-48b7-aede-12eabc213892 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:13 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:13 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 1073741824
Sep 20 16:58:13 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:14 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 1073741824" returned: 0 in 0.630s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:14 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892
Sep 20 16:58:14 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:14 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fc64c8-2047-4ce1-8d86-d67e6ded3647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919e6f73-8dc9-48b7-aede-12eabc213892', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519a2077-7815-43cb-85d8-6c0b5b8a218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Volume volume-919e6f73-8dc9-48b7-aede-12eabc213892 (919e6f73-8dc9-48b7-aede-12eabc213892): created successfully
Sep 20 16:58:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519a2077-7815-43cb-85d8-6c0b5b8a218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Flow 'volume_create_manager' (e9c4c7ca-5473-4b35-afa0-fdacd9f323f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7df8b1e3-f07a-42eb-b123-9c4e39d2cdd7 tempest-VolumesActionsTest-1966484042 None] Created volume successfully.
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Flow 'volume_create_manager' (1c54e3ca-e8d6-4987-9874-ce4ad3d9da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28669f2c-ffe2-4d6b-8e58-f807cdd6630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28669f2c-ffe2-4d6b-8e58-f807cdd6630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979740227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4e13f-5ed3-40d1-8979-0313c1f207c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b584a9c9970c4435b6950306fa10db79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:16Z,use_quota=True,user_id='a5a5194c577c4c07b1000defe6baf819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c4ed1-9d96-4349-88fb-14b84ccc350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c4ed1-9d96-4349-88fb-14b84ccc350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5ebfa4-fc53-4eb4-82fb-8057a66e06c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5ebfa4-fc53-4eb4-82fb-8057a66e06c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f4e13f-5ed3-40d1-8979-0313c1f207c2', 'volume_name': 'volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173ca3aa-b966-4cbd-98d9-79b563abc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173ca3aa-b966-4cbd-98d9-79b563abc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b9278-3b4a-4fb3-bc7d-12e04b779302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Volume 01f4e13f-5ed3-40d1-8979-0313c1f207c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2', 'volume_size': 1}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979740227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4e13f-5ed3-40d1-8979-0313c1f207c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b584a9c9970c4435b6950306fa10db79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:16Z,use_quota=True,user_id='a5a5194c577c4c07b1000defe6baf819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Creating volume 01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:16 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:16 devstack sudo[98034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 1073741824
Sep 20 16:58:16 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-919e6f73-8dc9-48b7-aede-12eabc213892-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-919e6f73-8dc9-48b7-aede-12eabc213892-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "cinder-quobyte-919e6f73-8dc9-48b7-aede-12eabc213892" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-quobyte-919e6f73-8dc9-48b7-aede-12eabc213892" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11fd71-4cc4-4f96-a927-3c5509821bdd]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:17 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892
Sep 20 16:58:17 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:17 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 1073741824" returned: 0 in 0.755s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:17 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:17 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:17 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892" returned: 0 in 0.617s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:17 devstack sudo[98048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892
Sep 20 16:58:17 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:17 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b9278-3b4a-4fb3-bc7d-12e04b779302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06cc57d-9059-4c09-bfe2-532739ae5f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Volume volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 (01f4e13f-5ed3-40d1-8979-0313c1f207c2): created successfully
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06cc57d-9059-4c09-bfe2-532739ae5f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Flow 'volume_create_manager' (1c54e3ca-e8d6-4987-9874-ce4ad3d9da28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-90255ff6-63b0-4165-9432-c0de48e20500 tempest-SnapshotDependencyTests-1059701026 None] Created volume successfully.
Sep 20 16:58:18 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-919e6f73-8dc9-48b7-aede-12eabc213892" returned: 0 in 0.524s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-quobyte-919e6f73-8dc9-48b7-aede-12eabc213892" released by "delete_volume" :: held 1.213s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Created reservations ['096e7b35-72fa-4d74-bdda-244110a8e8e7', '0b360a2d-c55c-4d22-85af-4605e5b4d7fc', '9c7f6e4a-dbf1-4e5c-8b17-8a72afd9f795', 'f907685f-b298-44ba-8c56-15334ea842ec'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:18 devstack sudo[98052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:18 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:18 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.472s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Deleted volume successfully.
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4bf3a780-657b-44dd-a703-db013adb70e2 tempest-VolumesActionsTest-1966484042 None] Lock "cinder-919e6f73-8dc9-48b7-aede-12eabc213892-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Creating offline snapshot cc48ccd2-243b-4a7b-8744-011f37f1a5a7 of volume 01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d980f-d7ce-469d-bf4b-f571e8b8664a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:19 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:19 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:19 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.589s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:19 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 1G
Sep 20 16:58:19 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:20 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 1G" returned: 0 in 0.569s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:20 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:20 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:20 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:20 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 is being set with open permissions: ugo+rw
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:20 devstack sudo[98072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:20 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:20 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:20 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info
Sep 20 16:58:20 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:21 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info" returned: 0 in 0.329s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:21 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info is being set with open permissions: ugo+rw
Sep 20 16:58:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:21 devstack sudo[98078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info
Sep 20 16:58:21 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:21 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.info" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ceba656d-4361-49f3-a152-e0bf9b0e4190 tempest-SnapshotDependencyTests-1059701026 None] Create snapshot completed successfully
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Flow 'volume_create_manager' (56e9c50d-1da8-4638-aefc-192a27e03652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7034bb7f-7f45-41b1-89f9-6c7b4af33667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7034bb7f-7f45-41b1-89f9-6c7b4af33667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e56c257-ee74-4fc8-a692-8ae2aa04e394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b584a9c9970c4435b6950306fa10db79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc48ccd2-243b-4a7b-8744-011f37f1a5a7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:23Z,use_quota=True,user_id='a5a5194c577c4c07b1000defe6baf819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5bd255-dae7-49d3-90d7-217d8c6df0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5bd255-dae7-49d3-90d7-217d8c6df0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96db6bd7-c143-4a15-812c-97fb10bd0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96db6bd7-c143-4a15-812c-97fb10bd0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e56c257-ee74-4fc8-a692-8ae2aa04e394', 'volume_name': 'volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394', 'volume_size': 1, 'snapshot_id': 'cc48ccd2-243b-4a7b-8744-011f37f1a5a7'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cc5178-ddc6-48ed-b40f-ecd3d0d9f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cc5178-ddc6-48ed-b40f-ecd3d0d9f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad1029d-d46c-4e35-95b0-146d95a7313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Volume 8e56c257-ee74-4fc8-a692-8ae2aa04e394: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394', 'volume_size': 1, 'snapshot_id': 'cc48ccd2-243b-4a7b-8744-011f37f1a5a7'}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-8e56c257-ee74-4fc8-a692-8ae2aa04e394" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-8e56c257-ee74-4fc8-a692-8ae2aa04e394" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Creating volume 8e56c257-ee74-4fc8-a692-8ae2aa04e394 from snapshot cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] snapshot: cc48ccd2-243b-4a7b-8744-011f37f1a5a7, volume: 8e56c257-ee74-4fc8-a692-8ae2aa04e394,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab7ba3-c274-460e-9838-97a12d46b9d7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:23 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:23 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:23 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442d24e-0bb3-4dfd-b093-9aaa1502a633]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:23 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:23 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:23 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.436s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 16:58:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:24 devstack sudo[98093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394
Sep 20 16:58:24 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:32 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394" returned: 0 in 8.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a9a97-7579-4874-b41c-c41782b2dcb5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:32 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:32 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:32 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=19,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=36,cinder:INSERT=5,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:58:33 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.643s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 16:58:33 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Converted 1024.00 MB image at 119.71 MB/s
Sep 20 16:58:33 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 is being set with open permissions: ugo+rw
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:33 devstack sudo[98116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394
Sep 20 16:58:33 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:33 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394" returned: 0 in 0.280s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" released by "_copy_volume_from_snapshot" :: held 10.431s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-8e56c257-ee74-4fc8-a692-8ae2aa04e394" released by "_create_volume_from_snapshot" :: held 10.471s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.497s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad1029d-d46c-4e35-95b0-146d95a7313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394', 'volume_size': 1, 'snapshot_id': 'cc48ccd2-243b-4a7b-8744-011f37f1a5a7'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7a2bbb-b58c-49bd-b11d-ef2dd703fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Volume volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 (8e56c257-ee74-4fc8-a692-8ae2aa04e394): created successfully
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7a2bbb-b58c-49bd-b11d-ef2dd703fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Flow 'volume_create_manager' (56e9c50d-1da8-4638-aefc-192a27e03652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ecf9af5f-15fa-4710-b737-294f5e320715 tempest-SnapshotDependencyTests-1059701026 None] Created volume successfully.
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Deleting offline snapshot cc48ccd2-243b-4a7b-8744-011f37f1a5a7 of volume 01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] snapshot_file for this snap is: volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2a74a-7a7e-425f-9473-4ec8b6bd8aa9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:34 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:34 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:34 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594cc1e-853b-43da-814c-6b82948f548b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:34 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:34 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:34 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:34 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:34 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:35 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.536s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:35 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7
Sep 20 16:58:35 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:35 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2.cc48ccd2-243b-4a7b-8744-011f37f1a5a7" returned: 0 in 0.259s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-cc48ccd2-243b-4a7b-8744-011f37f1a5a7" released by "_delete_snapshot" :: held 1.747s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" released by "delete_snapshot" :: held 1.774s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Created reservations ['014cabcd-5501-4c1f-b865-2508e0e884a1', 'd7078d2b-7931-479f-9317-92e8e1382e08', '3f7726eb-2715-4d67-8606-da41cd768372', '8e8eabd9-30de-4d52-b3fa-f5c44cc70b84'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Delete snapshot completed successfully.
Sep 20 16:58:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0ca20ebf-4541-4d59-8d20-43d48232c75a tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-cc48ccd2-243b-4a7b-8744-011f37f1a5a7-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-01f4e13f-5ed3-40d1-8979-0313c1f207c2-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-01f4e13f-5ed3-40d1-8979-0313c1f207c2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a0664-da3d-49c7-bd36-7b1184100736]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:36 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:36 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:36 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:36 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2
Sep 20 16:58:36 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:37 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-01f4e13f-5ed3-40d1-8979-0313c1f207c2" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-01f4e13f-5ed3-40d1-8979-0313c1f207c2" released by "delete_volume" :: held 0.820s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Created reservations ['53230558-860c-412f-820a-d55878bcb783', '0aeaab91-0d86-45f3-992d-05128d16c1e8', 'f6242fbf-7408-44a5-adb0-95aa7b08f298', '9c82185d-f066-4e62-a8af-8685a678a431'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:37 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:37 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-8e56c257-ee74-4fc8-a692-8ae2aa04e394-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-8e56c257-ee74-4fc8-a692-8ae2aa04e394-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:37 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" acquired by "delete_volume" :: waited 0.049s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Deleted volume successfully.
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2d617-1e65-4390-97c7-b039a5297d7e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8887c8be-b738-436e-abb4-94c1996a349f tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-01f4e13f-5ed3-40d1-8979-0313c1f207c2-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:37 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394
Sep 20 16:58:37 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:38 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394" returned: 0 in 0.511s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:38 devstack sudo[98159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394
Sep 20 16:58:38 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:38 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e56c257-ee74-4fc8-a692-8ae2aa04e394" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-quobyte-8e56c257-ee74-4fc8-a692-8ae2aa04e394" released by "delete_volume" :: held 1.010s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Created reservations ['f8cab507-6ff9-4365-a0c8-5df6989fbbbc', '4c22835a-f057-4bd2-8f2f-a7bc1cbfb16b', '22e0b722-8be8-475e-9687-9bd8b82b7f7d', 'e2b57776-f6f5-4bf5-b7b3-1a633ebeb09d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:38 devstack sudo[98162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:38 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:39 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.500s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:39 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Deleted volume successfully.
Sep 20 16:58:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-966f94ba-3c45-4465-825d-968f88bc968d tempest-SnapshotDependencyTests-1059701026 None] Lock "cinder-8e56c257-ee74-4fc8-a692-8ae2aa04e394-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (e3885af6-3f02-41f2-9739-ec47e5b11e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a81447-6e71-41ef-9b54-2ab055610083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a81447-6e71-41ef-9b54-2ab055610083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657837529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6b60f2-fffe-4b02-95cb-6efd2f462ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:45Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41acb2fd-e374-428d-a780-a7935e205eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41acb2fd-e374-428d-a780-a7935e205eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d963a98-9bbf-4253-8890-89d0540e5a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d963a98-9bbf-4253-8890-89d0540e5a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6b60f2-fffe-4b02-95cb-6efd2f462ae7', 'volume_name': 'volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3179a3bc-705a-4ae1-8469-9e49071a74d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3179a3bc-705a-4ae1-8469-9e49071a74d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056cc242-eed7-4202-ba11-a0d89b0878a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Volume ec6b60f2-fffe-4b02-95cb-6efd2f462ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7', 'volume_size': 1}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657837529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6b60f2-fffe-4b02-95cb-6efd2f462ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:45Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Creating volume ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:45 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:45 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 1073741824
Sep 20 16:58:45 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:46 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 1073741824" returned: 0 in 0.950s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:46 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7
Sep 20 16:58:46 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:46 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" returned: 0 in 0.565s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056cc242-eed7-4202-ba11-a0d89b0878a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9392d8-a14c-4bcb-9995-4765074c3fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:46 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Volume volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 (ec6b60f2-fffe-4b02-95cb-6efd2f462ae7): created successfully
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9392d8-a14c-4bcb-9995-4765074c3fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (e3885af6-3f02-41f2-9739-ec47e5b11e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ccfd3528-8679-401d-a6ef-f6bb894465df tempest-VolumesListAdminTestJSON-1604575271 None] Created volume successfully.
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (89875746-6a4f-46e3-b980-2480d6727333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a751633-fbeb-4f30-afcf-1f3679012c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a751633-fbeb-4f30-afcf-1f3679012c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-705772002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccad0fe4-dcde-43c4-920e-d772473b8983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:48Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f62aaa-a51c-456e-8852-4647793d65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f62aaa-a51c-456e-8852-4647793d65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e40274-36ba-4fc7-a48d-e25e1d948f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e40274-36ba-4fc7-a48d-e25e1d948f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccad0fe4-dcde-43c4-920e-d772473b8983', 'volume_name': 'volume-ccad0fe4-dcde-43c4-920e-d772473b8983', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc2be1f-6bff-43e3-aefc-e11a80e92ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc2be1f-6bff-43e3-aefc-e11a80e92ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b653179d-589d-4c20-b03b-aa31c6f1abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:48 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Volume ccad0fe4-dcde-43c4-920e-d772473b8983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccad0fe4-dcde-43c4-920e-d772473b8983', 'volume_size': 1}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-705772002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccad0fe4-dcde-43c4-920e-d772473b8983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:48Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Creating volume ccad0fe4-dcde-43c4-920e-d772473b8983 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:48 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:48 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 1073741824
Sep 20 16:58:48 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:49 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 1073741824" returned: 0 in 0.971s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:49 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983
Sep 20 16:58:49 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:49 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b653179d-589d-4c20-b03b-aa31c6f1abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccad0fe4-dcde-43c4-920e-d772473b8983', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79832827-e9e9-4299-a528-1872301b3223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Volume volume-ccad0fe4-dcde-43c4-920e-d772473b8983 (ccad0fe4-dcde-43c4-920e-d772473b8983): created successfully
Sep 20 16:58:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79832827-e9e9-4299-a528-1872301b3223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (89875746-6a4f-46e3-b980-2480d6727333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-99656851-99cd-4701-bf95-5edbe97a31ed tempest-VolumesListAdminTestJSON-1604575271 None] Created volume successfully.
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (2bedbc9e-f4e6-4084-aaef-7057e8414c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411fa90-f715-44ae-bc6f-9efe5dd7794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411fa90-f715-44ae-bc6f-9efe5dd7794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320962466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ee3d86-e06b-445f-b396-8d36e9bad2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:52Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a75b4c-67bc-4337-8f39-f4f162607fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a75b4c-67bc-4337-8f39-f4f162607fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411bd514-c397-4d2a-a36e-3db469a4b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411bd514-c397-4d2a-a36e-3db469a4b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ee3d86-e06b-445f-b396-8d36e9bad2f4', 'volume_name': 'volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d79dc2-0bd6-4df6-adad-9bdb29085e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d79dc2-0bd6-4df6-adad-9bdb29085e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665dc7cb-7a79-4a73-80d8-20c1763df72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Volume 67ee3d86-e06b-445f-b396-8d36e9bad2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4', 'volume_size': 1}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320962466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ee3d86-e06b-445f-b396-8d36e9bad2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996ce10f459841c3bcb03a72094a54b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:52Z,use_quota=True,user_id='7888377ba5bb4510accf970343684d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Creating volume 67ee3d86-e06b-445f-b396-8d36e9bad2f4 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:51 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:51 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 1073741824
Sep 20 16:58:51 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:52 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 1073741824" returned: 0 in 0.662s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:52 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4
Sep 20 16:58:52 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:52 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665dc7cb-7a79-4a73-80d8-20c1763df72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b80ad41-5223-44d7-8043-63d2e964defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Volume volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 (67ee3d86-e06b-445f-b396-8d36e9bad2f4): created successfully
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b80ad41-5223-44d7-8043-63d2e964defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Flow 'volume_create_manager' (2bedbc9e-f4e6-4084-aaef-7057e8414c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ae931314-7d3f-41a0-aa4c-da1d804f454f tempest-VolumesListAdminTestJSON-1604575271 None] Created volume successfully.
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Flow 'volume_create_manager' (cf3d5e51-3bbb-4b82-a80c-709afb94ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae86003a-f2c9-48bc-a914-036905890627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae86003a-f2c9-48bc-a914-036905890627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0408e0f9-ae52-4fcc-bea4-c1de9c79accb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329332be30e3474e9d361d1ae9d6f772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:55Z,use_quota=True,user_id='64f7b268e70f4f96a89f358d83d422f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473cc856-fd5a-453a-a6d9-7118c58d4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473cc856-fd5a-453a-a6d9-7118c58d4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8510d9f-e125-4503-a243-a0ceb203a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8510d9f-e125-4503-a243-a0ceb203a208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0408e0f9-ae52-4fcc-bea4-c1de9c79accb', 'volume_name': 'volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aecf478-f0d1-4d65-8259-db24a98caffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aecf478-f0d1-4d65-8259-db24a98caffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec54206b-4abd-4858-bb2a-b1bedd752739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Volume 0408e0f9-ae52-4fcc-bea4-c1de9c79accb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb', 'volume_size': 1}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0408e0f9-ae52-4fcc-bea4-c1de9c79accb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329332be30e3474e9d361d1ae9d6f772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:58:55Z,use_quota=True,user_id='64f7b268e70f4f96a89f358d83d422f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Creating volume 0408e0f9-ae52-4fcc-bea4-c1de9c79accb {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:58:54 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:58:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:54 devstack sudo[98354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb 1073741824
Sep 20 16:58:54 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:55 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb 1073741824" returned: 0 in 0.530s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:55 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb
Sep 20 16:58:55 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:55 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" returned: 0 in 0.500s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec54206b-4abd-4858-bb2a-b1bedd752739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ca1f3-f369-41c4-8a34-8591f72ad929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:58:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Volume volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb (0408e0f9-ae52-4fcc-bea4-c1de9c79accb): created successfully
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ca1f3-f369-41c4-8a34-8591f72ad929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:58:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Flow 'volume_create_manager' (cf3d5e51-3bbb-4b82-a80c-709afb94ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:58:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-07695f57-94d0-4ae9-a9e1-810bed755021 tempest-VolumesListAdminTestJSON-1716344776 None] Created volume successfully.
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Acquiring lock "cinder-0408e0f9-ae52-4fcc-bea4-c1de9c79accb-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "cinder-0408e0f9-ae52-4fcc-bea4-c1de9c79accb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Acquiring lock "cinder-quobyte-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "cinder-quobyte-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" acquired by "delete_volume" :: waited 0.064s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11bd93-ff40-4d9d-85c0-9b3886333462]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-67ee3d86-e06b-445f-b396-8d36e9bad2f4-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-67ee3d86-e06b-445f-b396-8d36e9bad2f4-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-quobyte-67ee3d86-e06b-445f-b396-8d36e9bad2f4" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:58:57 devstack sudo[98430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb
Sep 20 16:58:57 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-67ee3d86-e06b-445f-b396-8d36e9bad2f4" acquired by "delete_volume" :: waited 0.078s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed870b7-a4a6-4db3-8215-a92843ebd23c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:58 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:58 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:58 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" returned: 0 in 1.025s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:58 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb
Sep 20 16:58:58 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:58 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4
Sep 20 16:58:58 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:58 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.600s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:58:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:58:59 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4" returned: 0 in 1.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:59 devstack sudo[98469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4
Sep 20 16:58:59 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:59 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" returned: 0 in 0.917s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "cinder-quobyte-0408e0f9-ae52-4fcc-bea4-c1de9c79accb" released by "delete_volume" :: held 2.071s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Created reservations ['6606f03e-57ff-4d23-8350-f36e5cccc8e0', 'd4ed69fa-9933-429d-b739-91302cb27d4b', '890a42d1-73c7-474c-885e-3dcd2cd57f37', 'ddd1e777-b63e-4d1f-b323-829e09eda69e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:58:59 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-67ee3d86-e06b-445f-b396-8d36e9bad2f4" returned: 0 in 0.355s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-67ee3d86-e06b-445f-b396-8d36e9bad2f4" released by "delete_volume" :: held 1.831s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:58:59 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:58:59 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:58:59 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Created reservations ['4f2dc42c-520b-4e60-a07f-7eea1543dc98', '6d18475c-226b-4b04-8f43-7689e4d222f7', '29a13424-4d87-4243-8981-87b69053d00b', '9da27283-68d0-4952-8182-d6b6d2806073'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:00 devstack sudo[98481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:00 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:00 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.548s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Deleted volume successfully.
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-19a54c38-ea1a-4c2b-8f23-36cfda95279c tempest-VolumesListAdminTestJSON-1716344776 None] Lock "cinder-0408e0f9-ae52-4fcc-bea4-c1de9c79accb-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-ccad0fe4-dcde-43c4-920e-d772473b8983-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:00 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.463s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Deleted volume successfully.
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-ccad0fe4-dcde-43c4-920e-d772473b8983-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-35af0014-7eb9-4b2b-8e23-14074cb193bc tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-67ee3d86-e06b-445f-b396-8d36e9bad2f4-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-quobyte-ccad0fe4-dcde-43c4-920e-d772473b8983" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-ccad0fe4-dcde-43c4-920e-d772473b8983" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd50f4e-7a91-4c00-a0b5-6cb1d6c5ea57]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:00 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983
Sep 20 16:59:00 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:01 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983" returned: 0 in 0.626s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:01 devstack sudo[98492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983
Sep 20 16:59:01 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:01 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ccad0fe4-dcde-43c4-920e-d772473b8983" returned: 0 in 0.344s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-ccad0fe4-dcde-43c4-920e-d772473b8983" released by "delete_volume" :: held 1.044s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Created reservations ['25939602-1d8a-422d-b504-85eacf8d2511', 'da8c8821-9b2b-488c-9a75-3f6fe5f1198b', '60831436-6954-49df-a83c-29259c8f924c', '4cb0adca-f8e0-4a91-bb28-01805d01a5c7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:01 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:01 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:59:02 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Flow 'volume_create_manager' (c73d47b2-8951-4cc0-b401-eaa5d753605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bbaebe-caeb-4292-8785-060d0bf06a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.426s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Deleted volume successfully.
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bbaebe-caeb-4292-8785-060d0bf06a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-591561888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7095e0c3-3c1f-46d1-a343-a5533fcf4a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21af7c8147e642c3bce0eaa1684a5015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:02Z,use_quota=True,user_id='c356c6fa368d4a77b4daa04e0ecead67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925641da-535a-4ee7-88f1-59b935dba44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925641da-535a-4ee7-88f1-59b935dba44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145cfb6-02a1-41ea-b9d8-417eb4625ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145cfb6-02a1-41ea-b9d8-417eb4625ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7095e0c3-3c1f-46d1-a343-a5533fcf4a64', 'volume_name': 'volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2f5b4d-64e7-4e4a-968d-5393721d5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2f5b4d-64e7-4e4a-968d-5393721d5a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b99c060-3936-4a83-a502-b867cdc16833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:02 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Volume 7095e0c3-3c1f-46d1-a343-a5533fcf4a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64', 'volume_size': 1}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-591561888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7095e0c3-3c1f-46d1-a343-a5533fcf4a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21af7c8147e642c3bce0eaa1684a5015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:02Z,use_quota=True,user_id='c356c6fa368d4a77b4daa04e0ecead67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Creating volume 7095e0c3-3c1f-46d1-a343-a5533fcf4a64 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:59:02 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-756c5fa8-ebcf-4087-8956-2c53d553a38a tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-ccad0fe4-dcde-43c4-920e-d772473b8983-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:02 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 1073741824
Sep 20 16:59:02 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:02 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 1073741824" returned: 0 in 0.450s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:02 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64
Sep 20 16:59:02 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "cinder-quobyte-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f16fce-b463-4f53-bb80-ff88f30974b9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:03 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b99c060-3936-4a83-a502-b867cdc16833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4553fc0f-7adb-4c14-8719-f4a01328f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:03 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7
Sep 20 16:59:03 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:03 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Volume volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 (7095e0c3-3c1f-46d1-a343-a5533fcf4a64): created successfully
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4553fc0f-7adb-4c14-8719-f4a01328f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Flow 'volume_create_manager' (c73d47b2-8951-4cc0-b401-eaa5d753605d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f9ed9eaf-b38d-4e36-8646-f2c144eea643 tempest-TestMinimumBasicScenario-1271929411 None] Created volume successfully.
Sep 20 16:59:03 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" returned: 0 in 0.388s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:03 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7
Sep 20 16:59:03 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:03 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-quobyte-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7" released by "delete_volume" :: held 0.708s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Created reservations ['4a323e1f-62ac-4151-b165-06160000a7c6', 'c0b36a5c-2fe0-4e0a-868c-2a5b7f7cd1b5', '0e7958c3-c2ee-4937-825d-bcd4d300887d', 'd6efe495-4c89-4ac9-a39d-8a84fd7b0010'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:03 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:03 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:04 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Deleted volume successfully.
Sep 20 16:59:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a347101-3901-4efd-8e0b-f4522c71a8c0 tempest-VolumesListAdminTestJSON-1604575271 None] Lock "cinder-ec6b60f2-fffe-4b02-95cb-6efd2f462ae7-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1831f55-c739-4cbf-8806-a4a0b0301d40]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:05 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64
Sep 20 16:59:05 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:05 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.427s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9aa44024-87f3-4669-bc9e-44668c4b4439', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:59:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-bec47565-323d-426d-b274-d3138776aeed req-7c1e3081-ca59-4b88-991b-cd784c4fe9c2 tempest-TestMinimumBasicScenario-1271929411 None] attachment_update completed successfully.
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (aec54df2-52f8-4e0e-8579-6547f3dd2ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2266d3a-c90e-4329-b33a-743ae2e13ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2266d3a-c90e-4329-b33a-743ae2e13ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-304759155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852a99ab-1185-48ef-b061-389343014254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:11Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832deb00-7257-4325-9b0e-2be8804df934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832deb00-7257-4325-9b0e-2be8804df934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0270d823-c2e2-4ef1-824c-68a506756015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0270d823-c2e2-4ef1-824c-68a506756015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852a99ab-1185-48ef-b061-389343014254', 'volume_name': 'volume-852a99ab-1185-48ef-b061-389343014254', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38766a-299a-407f-ba57-a813b19d1b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38766a-299a-407f-ba57-a813b19d1b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dcb597-56fa-4af4-937d-40b387fbf01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Volume 852a99ab-1185-48ef-b061-389343014254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852a99ab-1185-48ef-b061-389343014254', 'volume_size': 1}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-304759155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852a99ab-1185-48ef-b061-389343014254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6859b3cc6548b584fad4ef4b9e9e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:11Z,use_quota=True,user_id='9ff02bf1ce8c4d6c895c34e80dbf79f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Creating volume 852a99ab-1185-48ef-b061-389343014254 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:59:11 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:11 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 1073741824
Sep 20 16:59:11 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Flow 'volume_create_manager' (549351e4-09f6-4cc2-9913-d802de790881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ee2b9-a876-4691-a5e6-1c98b95dea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ee2b9-a876-4691-a5e6-1c98b95dea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1068130108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6984e1b2-1caf-4331-9650-70f3c4248cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975f1ae581d349808ebbff36d5f8e97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:12Z,use_quota=True,user_id='363c29fee5fd4223a0ec0b97a4498806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b75843c-6ecf-4ab3-95ee-de778b626981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b75843c-6ecf-4ab3-95ee-de778b626981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4761390-f910-4d94-bf6f-2d953dd6a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4761390-f910-4d94-bf6f-2d953dd6a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6984e1b2-1caf-4331-9650-70f3c4248cdb', 'volume_name': 'volume-6984e1b2-1caf-4331-9650-70f3c4248cdb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fea6e0f-1248-4fdf-ae26-507acc99fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fea6e0f-1248-4fdf-ae26-507acc99fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8c9db0-87a8-4c6a-9a0c-27e0d719d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Volume 6984e1b2-1caf-4331-9650-70f3c4248cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6984e1b2-1caf-4331-9650-70f3c4248cdb', 'volume_size': 1}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 1073741824" returned: 0 in 0.851s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:12 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254
Sep 20 16:59:12 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:12 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1068130108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6984e1b2-1caf-4331-9650-70f3c4248cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975f1ae581d349808ebbff36d5f8e97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:12Z,use_quota=True,user_id='363c29fee5fd4223a0ec0b97a4498806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Creating volume 6984e1b2-1caf-4331-9650-70f3c4248cdb {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:59:12 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:12 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb 1073741824
Sep 20 16:59:12 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dcb597-56fa-4af4-937d-40b387fbf01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852a99ab-1185-48ef-b061-389343014254', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6b3265-64eb-45b8-b979-8513be207197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Volume volume-852a99ab-1185-48ef-b061-389343014254 (852a99ab-1185-48ef-b061-389343014254): created successfully
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6b3265-64eb-45b8-b979-8513be207197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Flow 'volume_create_manager' (aec54df2-52f8-4e0e-8579-6547f3dd2ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b1914e5c-51f4-4ddc-bef1-163fe4f252ff tempest-AttachVolumeNegativeTest-210240145 None] Created volume successfully.
Sep 20 16:59:12 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb 1073741824" returned: 0 in 0.494s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:13 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb
Sep 20 16:59:13 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:13 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8c9db0-87a8-4c6a-9a0c-27e0d719d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6984e1b2-1caf-4331-9650-70f3c4248cdb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5779c870-85b6-4cfc-a9c3-ad25151c60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Volume volume-6984e1b2-1caf-4331-9650-70f3c4248cdb (6984e1b2-1caf-4331-9650-70f3c4248cdb): created successfully
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5779c870-85b6-4cfc-a9c3-ad25151c60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Flow 'volume_create_manager' (549351e4-09f6-4cc2-9913-d802de790881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0eca75c3-55ca-413c-8488-a61325adb819 tempest-AbsoluteLimitsTests-304193154 None] Created volume successfully.
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e8b85-6421-425d-9781-625ca94ff554]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Acquiring lock "cinder-6984e1b2-1caf-4331-9650-70f3c4248cdb-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "cinder-6984e1b2-1caf-4331-9650-70f3c4248cdb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:14 devstack sudo[99012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254
Sep 20 16:59:14 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Acquiring lock "cinder-quobyte-6984e1b2-1caf-4331-9650-70f3c4248cdb" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "cinder-quobyte-6984e1b2-1caf-4331-9650-70f3c4248cdb" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d8630-5554-433c-a202-076bee3ab8c0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:14 devstack sudo[99014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb
Sep 20 16:59:14 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:14 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.446s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-852a99ab-1185-48ef-b061-389343014254', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9223a03a-c2c4-4207-bcaf-e15bab79dec1', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 16:59:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-fe992450-0602-4dde-917c-6620f7c71258 req-5e828993-3051-4a93-820c-64a3349e49e4 tempest-AttachVolumeNegativeTest-210240145 None] attachment_update completed successfully.
Sep 20 16:59:14 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:14 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb
Sep 20 16:59:14 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:15 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6984e1b2-1caf-4331-9650-70f3c4248cdb" returned: 0 in 0.381s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "cinder-quobyte-6984e1b2-1caf-4331-9650-70f3c4248cdb" released by "delete_volume" :: held 0.869s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Created reservations ['7f6619e8-26cc-4a76-b51d-bab1229c4a6a', 'b2e5f8cf-9986-4414-8c1c-2cdbe8c7ddba', '06a9d83d-bc37-485c-ae9b-4aec3b0cd50d', '7863e807-6f8b-4a0f-9cab-bff31735f81a'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:15 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:15 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:15 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.314s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Deleted volume successfully.
Sep 20 16:59:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b222e168-666a-4a85-99ad-17d4501a9479 tempest-AbsoluteLimitsTests-304193154 None] Lock "cinder-6984e1b2-1caf-4331-9650-70f3c4248cdb-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-8f69e447-5e40-4880-a9ff-d60b0f86c97d req-38c53cfa-cf2d-4e4e-9327-daae338d628b tempest-AttachVolumeNegativeTest-210240145 None] Terminate volume connection completed successfully.
Sep 20 16:59:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-8f69e447-5e40-4880-a9ff-d60b0f86c97d req-38c53cfa-cf2d-4e4e-9327-daae338d628b tempest-AttachVolumeNegativeTest-210240145 None] Deleting attachment 9223a03a-c2c4-4207-bcaf-e15bab79dec1. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-852a99ab-1185-48ef-b061-389343014254-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-852a99ab-1185-48ef-b061-389343014254-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-quobyte-852a99ab-1185-48ef-b061-389343014254" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-852a99ab-1185-48ef-b061-389343014254" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8774e88-4b2a-4771-b359-97111b548e65]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:23 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254
Sep 20 16:59:23 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:23 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254" returned: 0 in 0.440s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:23 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254
Sep 20 16:59:23 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:23 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-852a99ab-1185-48ef-b061-389343014254" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-852a99ab-1185-48ef-b061-389343014254" released by "delete_volume" :: held 0.749s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Created reservations ['30aab825-2ee0-48f6-92be-8b148836a9e6', '64771aa6-5635-4827-86c0-1433d85ee43c', '058dec11-241a-4a9b-9b1d-8495ec94b82d', '9ba7f8f4-bd92-4763-97a0-dea0f2db69b4'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:23 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:23 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:24 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Deleted volume successfully.
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91cfa39b-f260-4ee0-9a46-74ed8e9f7179 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-852a99ab-1185-48ef-b061-389343014254-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-quobyte-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49c57eb-1d30-4f93-9c44-5bc8b57f0bc1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:24 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a
Sep 20 16:59:24 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:24 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:24 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a
Sep 20 16:59:24 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:24 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a" released by "delete_volume" :: held 0.776s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Created reservations ['7ad03d72-1852-4666-9f57-adbfa4b8d1f1', 'a43308bf-b406-439f-8758-ff1691d855bd', '98f7fb9e-d142-4b9e-8a27-1a4f3dd57757', '420aba8d-20f4-4501-95ba-31386676ee38'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:25 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:25 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:25 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.374s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Deleted volume successfully.
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fbcbed19-2159-4dd7-81f2-a3a02c4dc21c tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-f5ec1ad2-47ea-4d68-94fd-e4713eeb9d5a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "cinder-quobyte-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[27969981-acf4-451c-a887-ce08b5258344]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:25 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a
Sep 20 16:59:25 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:26 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:26 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a
Sep 20 16:59:26 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:26 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-quobyte-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a" released by "delete_volume" :: held 0.841s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Created reservations ['1ba1d0b2-768c-4608-8a7b-d6d8bf2dd856', 'a51aa990-b9b7-419d-b36d-00006918a3fc', '2db6182a-6738-467d-9f8c-51c546a18e4b', '8ed856b7-3227-4623-aab1-be3e55c3f4f3'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:26 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:26 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:27 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:27 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Deleted volume successfully.
Sep 20 16:59:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c21c134-c0de-4740-bbad-bb4e4f133055 tempest-AttachVolumeNegativeTest-210240145 None] Lock "cinder-90cb44f6-b6e8-4356-aebe-6a4d6d336a2a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Flow 'volume_create_manager' (231e23e0-103a-4fea-94e0-177e77b48875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab346238-5a31-4bba-8ee5-ab8b69f11e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab346238-5a31-4bba-8ee5-ab8b69f11e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490468947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d391f-3c49-4f73-ba4f-03dc7c3ac896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c446ee7a434ff0a6a4fc23cc3a98a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:32Z,use_quota=True,user_id='24ebbd5b1a514a4b97b2bffdf9db4e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6599852e-669f-4df7-a64a-09b0dee5d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6599852e-669f-4df7-a64a-09b0dee5d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49184651-f476-43c7-9691-77e082ca1aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49184651-f476-43c7-9691-77e082ca1aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77d391f-3c49-4f73-ba4f-03dc7c3ac896', 'volume_name': 'volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a59ce7-6990-4c91-b376-5f62c7cb8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a59ce7-6990-4c91-b376-5f62c7cb8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a41957-e5b2-4d12-b41e-fdf5ec61e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896', 'volume_size': 1}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490468947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d391f-3c49-4f73-ba4f-03dc7c3ac896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c446ee7a434ff0a6a4fc23cc3a98a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:32Z,use_quota=True,user_id='24ebbd5b1a514a4b97b2bffdf9db4e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Creating volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:59:31 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:59:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:31 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 1073741824
Sep 20 16:59:31 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:32 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 1073741824" returned: 0 in 0.451s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:32 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 16:59:32 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:32 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.252s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a41957-e5b2-4d12-b41e-fdf5ec61e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c896e-3a93-4486-9845-087e34a13011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Volume volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 (b77d391f-3c49-4f73-ba4f-03dc7c3ac896): created successfully
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c896e-3a93-4486-9845-087e34a13011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Flow 'volume_create_manager' (231e23e0-103a-4fea-94e0-177e77b48875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c9cb676b-5c7f-49a4-8b26-5f0b59634181 tempest-VolumesActionsTest-1370284008 None] Created volume successfully.
Sep 20 16:59:33 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=113,cinder:SELECT=81,cinder:INSERT=28,cinder:DELETE=13 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:59:33 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=88,cinder:UPDATE=116,cinder:DELETE=6,cinder:INSERT=24 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 16:59:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8ad2825d-c1fe-465e-832a-4a85c04f31dc tempest-GroupSnapshotsV319Test-1405910658 None] Group tempest-GroupSnapshotsV319Test-Group-59768039: creating
Sep 20 16:59:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8ad2825d-c1fe-465e-832a-4a85c04f31dc tempest-GroupSnapshotsV319Test-1405910658 None] Group tempest-GroupSnapshotsV319Test-Group-59768039: created successfully
Sep 20 16:59:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8ad2825d-c1fe-465e-832a-4a85c04f31dc tempest-GroupSnapshotsV319Test-1405910658 None] Create group completed successfully.
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Flow 'volume_create_manager' (69a076b5-adc6-48ce-be0e-e761484577d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71e358a-0bd0-4e75-930d-610a8382d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71e358a-0bd0-4e75-930d-610a8382d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T14:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-174651184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bc9be25f-9e06-4293-bee9-ffc39058cb15,host='devstack@QuobyteHD#QuobyteHD',id=2012cdad-ca82-47a4-99ac-77ca6e8ae15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4256bb2d394255b5389dfae83f21ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:41Z,use_quota=True,user_id='3d706c8d5deb4bf4b47436b6df372dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce6b532c-6796-4022-af6a-12c3f0985281),volume_type_id=ce6b532c-6796-4022-af6a-12c3f0985281)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748a488-3424-41cc-8e64-e373b5f5849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748a488-3424-41cc-8e64-e373b5f5849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53cdb8a-230a-4e11-99de-ae2616f7fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53cdb8a-230a-4e11-99de-ae2616f7fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2012cdad-ca82-47a4-99ac-77ca6e8ae15c', 'volume_name': 'volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cee145e-f7b2-4bcb-afcf-4ad53ec6c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cee145e-f7b2-4bcb-afcf-4ad53ec6c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ea819-7761-4def-85fe-3920c06e485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:41 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Volume 2012cdad-ca82-47a4-99ac-77ca6e8ae15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c', 'volume_size': 1}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bc9be25f-9e06-4293-bee9-ffc39058cb15,created_at=2026-09-20T14:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-174651184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bc9be25f-9e06-4293-bee9-ffc39058cb15,host='devstack@QuobyteHD#QuobyteHD',id=2012cdad-ca82-47a4-99ac-77ca6e8ae15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4256bb2d394255b5389dfae83f21ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T14:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T14:59:41Z,use_quota=True,user_id='3d706c8d5deb4bf4b47436b6df372dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce6b532c-6796-4022-af6a-12c3f0985281),volume_type_id=ce6b532c-6796-4022-af6a-12c3f0985281)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Creating volume 2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 16:59:41 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 16:59:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:41 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c 1073741824
Sep 20 16:59:41 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:42 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c 1073741824" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:42 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c
Sep 20 16:59:42 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:42 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" returned: 0 in 0.293s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ea819-7761-4def-85fe-3920c06e485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae7fff8-c314-4089-ab8c-da0255d774ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 16:59:42 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Volume volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c (2012cdad-ca82-47a4-99ac-77ca6e8ae15c): created successfully
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae7fff8-c314-4089-ab8c-da0255d774ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 16:59:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Flow 'volume_create_manager' (69a076b5-adc6-48ce-be0e-e761484577d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 16:59:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d74a910f-6974-4463-8e37-d9eb728e9bb2 tempest-GroupSnapshotsV319Test-1405910658 None] Created volume successfully.
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fffe5f41-b836-43ac-966a-9873d0548e7c tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" by "attach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fffe5f41-b836-43ac-966a-9873d0548e7c tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" acquired by "attach_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fffe5f41-b836-43ac-966a-9873d0548e7c tempest-VolumesActionsTest-1370284008 None] Attaching volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896 to instance 071c2dee-5d54-434a-baa8-e59bd9ef22f5 at mountpoint /dev/vdb on host None.
Sep 20 16:59:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fffe5f41-b836-43ac-966a-9873d0548e7c tempest-VolumesActionsTest-1370284008 None] Attach volume completed successfully.
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-fffe5f41-b836-43ac-966a-9873d0548e7c tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" released by "attach_volume" :: held 0.111s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4c5eea26-0eda-499f-bf6a-47f1269770a9 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" by "detach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4c5eea26-0eda-499f-bf6a-47f1269770a9 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4c5eea26-0eda-499f-bf6a-47f1269770a9 tempest-VolumesActionsTest-1370284008 None] Detaching volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896 from instance 071c2dee-5d54-434a-baa8-e59bd9ef22f5.
Sep 20 16:59:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4c5eea26-0eda-499f-bf6a-47f1269770a9 tempest-VolumesActionsTest-1370284008 None] Detach volume completed successfully.
Sep 20 16:59:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4c5eea26-0eda-499f-bf6a-47f1269770a9 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] GroupSnapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: creating.
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Group snapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: creating. {{(pid=85945) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Creating offline snapshot 5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef of volume 2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd4792-d867-4cd2-bb0c-bfbdbfdd8871]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:44 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c
Sep 20 16:59:44 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:44 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:44 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef 1G
Sep 20 16:59:44 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:45 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef 1G" returned: 0 in 0.461s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:45 devstack sudo[99310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef
Sep 20 16:59:45 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:45 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" returned: 0 in 0.388s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:45 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:45 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef
Sep 20 16:59:45 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:45 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:45 devstack sudo[99321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info
Sep 20 16:59:45 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:45 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:45 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 16:59:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:45 devstack sudo[99324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info
Sep 20 16:59:45 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:46 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.info" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c347563a-51da-4025-a298-5c0caadf2ad3 tempest-GroupSnapshotsV319Test-1405910658 None] group_snapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: created successfully
Sep 20 16:59:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] group_snapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: deleting
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] group_snapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: deleting {{(pid=85945) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "cinder-quobyte-5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Deleting offline snapshot 5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef of volume 2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] snapshot_file for this snap is: volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d19793d-b8b4-43d6-ad58-39b0b66800fa]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:48 devstack sudo[99330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef
Sep 20 16:59:48 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:48 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" returned: 0 in 0.537s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b530393-919e-48d3-9145-1cc49247b1e6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:48 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c
Sep 20 16:59:48 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:48 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" returned: 0 in 0.455s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:48 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef
Sep 20 16:59:48 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:49 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:49 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef
Sep 20 16:59:49 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:49 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c.5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" returned: 0 in 0.347s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-5cd8b03a-39c2-4fcb-b3da-97e4d3bc62ef" released by "_delete_snapshot" :: held 1.894s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" released by "delete_snapshot" :: held 1.932s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:49 devstack cinder-volume[85945]: WARNING cinder.quota [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-992555131 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-992555131, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:59:49 devstack cinder-volume[85945]: WARNING cinder.quota [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-992555131 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-992555131, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:59:49 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] Created reservations ['01849080-2be6-40eb-9b2b-bc00fb499cd1', 'a077127e-67da-4373-b3da-7080b546bbd9', '0fcb1f13-1010-456a-ac52-8317e2bcbe37', 'bd2bacc3-81fe-497c-b1eb-f96ddd2303e5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-13848e7d-786a-4272-ade1-e057bba8453e tempest-GroupSnapshotsV319Test-1405910658 None] group_snapshot 7fe49353-4175-48bd-b679-83cda0a4a75f: deleted successfully
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c929a-a680-4cb8-9b86-4705c141e080]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:50 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c
Sep 20 16:59:50 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:50 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" returned: 0 in 0.399s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:50 devstack sudo[99409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c
Sep 20 16:59:50 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:51 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Lock "cinder-quobyte-2012cdad-ca82-47a4-99ac-77ca6e8ae15c" released by "delete_volume" :: held 0.786s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Created reservations ['b8c0f9d4-28f6-40dc-b91b-8a96ff4dcd57'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:51 devstack cinder-volume[85945]: WARNING cinder.quota [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-992555131 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-992555131, it is now deprecated. Please use the default quota class for default quota.
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Created reservations ['51a2038c-a77a-4edd-a1af-a601ca286901', 'ba54e9a0-b896-4c2d-a23d-53fe10b3c9c7', '93535767-fe73-4741-9e19-b3b88f6a131d', '28918fac-4ca8-482b-b60f-68bca5e78c05'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:51 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:51 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:52 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.618s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:52 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cefec353-057b-47e6-98a6-61da5856929f tempest-GroupSnapshotsV319Test-1405910658 None] Delete group completed successfully.
Sep 20 16:59:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-82558e54-5205-4efa-858d-de285c367e69 req-44950611-22b5-4e73-9ade-446fd1b66055 tempest-TestMinimumBasicScenario-1271929411 None] Terminate volume connection completed successfully.
Sep 20 16:59:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-82558e54-5205-4efa-858d-de285c367e69 req-44950611-22b5-4e73-9ade-446fd1b66055 tempest-TestMinimumBasicScenario-1271929411 None] Deleting attachment 9aa44024-87f3-4669-bc9e-44668c4b4439. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 16:59:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-255e2dcd-1035-4127-b8df-535fcf8819fe tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" by "attach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-255e2dcd-1035-4127-b8df-535fcf8819fe tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" acquired by "attach_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-255e2dcd-1035-4127-b8df-535fcf8819fe tempest-VolumesActionsTest-1370284008 None] Attaching volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896 to instance 0de65700-d52b-40e7-b698-73553a3f0433 at mountpoint /dev/vdb on host None.
Sep 20 16:59:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-255e2dcd-1035-4127-b8df-535fcf8819fe tempest-VolumesActionsTest-1370284008 None] Attach volume completed successfully.
Sep 20 16:59:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-255e2dcd-1035-4127-b8df-535fcf8819fe tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" released by "attach_volume" :: held 0.122s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "cinder-7095e0c3-3c1f-46d1-a343-a5533fcf4a64-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "cinder-7095e0c3-3c1f-46d1-a343-a5533fcf4a64-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "cinder-quobyte-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "cinder-quobyte-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7932318d-1dbd-494f-ae14-cb602d4ea977]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:57 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64
Sep 20 16:59:57 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f36a0f54-e973-48a0-b921-35aeeb74deb5 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" by "detach_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f36a0f54-e973-48a0-b921-35aeeb74deb5 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 16:59:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f36a0f54-e973-48a0-b921-35aeeb74deb5 tempest-VolumesActionsTest-1370284008 None] Detaching volume b77d391f-3c49-4f73-ba4f-03dc7c3ac896 from instance 0de65700-d52b-40e7-b698-73553a3f0433.
Sep 20 16:59:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f36a0f54-e973-48a0-b921-35aeeb74deb5 tempest-VolumesActionsTest-1370284008 None] Detach volume completed successfully.
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f36a0f54-e973-48a0-b921-35aeeb74deb5 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:57 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" returned: 0 in 0.485s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:57 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64
Sep 20 16:59:57 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:58 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "cinder-quobyte-7095e0c3-3c1f-46d1-a343-a5533fcf4a64" released by "delete_volume" :: held 0.959s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Created reservations ['be727ab1-4166-49b4-98b5-ba566fd7c768', '5e1420c1-5d7e-4630-892a-ce3845606273', '5041c54c-5215-4829-8e41-57b658308c7b', '785cb89f-d941-49d2-90c6-855588c9c5e8'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 16:59:58 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:58 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 16:59:58 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 16:59:58 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 16:59:58 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 16:59:58 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.485s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 16:59:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Deleted volume successfully.
Sep 20 16:59:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8d0af604-3321-4f47-b070-1ff9a9cbc22c tempest-TestMinimumBasicScenario-1271929411 None] Lock "cinder-7095e0c3-3c1f-46d1-a343-a5533fcf4a64-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c5df4-2902-447d-8e55-55e9f0d91505]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:02 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:02 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:02 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.454s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a184f-b2db-457b-b394-4ca4257cd0c3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:03 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:03 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:03 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.433s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.3fb6cb24-beba-4cdd-abb7-31622925e051alvsjbjk.img {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:03 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.3fb6cb24-beba-4cdd-abb7-31622925e051alvsjbjk.img
Sep 20 17:00:03 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:08 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=38,cinder:SELECT=41,cinder:INSERT=10,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:00:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7d7acfd6-5767-4adf-ac13-f86bc95d4706 tempest-GroupsV314Test-2080111697 None] Group tempest-GroupsV314Test-Group-664103771: creating
Sep 20 17:00:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7d7acfd6-5767-4adf-ac13-f86bc95d4706 tempest-GroupsV314Test-2080111697 None] Group tempest-GroupsV314Test-Group-664103771: created successfully
Sep 20 17:00:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7d7acfd6-5767-4adf-ac13-f86bc95d4706 tempest-GroupsV314Test-2080111697 None] Create group completed successfully.
Sep 20 17:00:10 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.3fb6cb24-beba-4cdd-abb7-31622925e051alvsjbjk.img" returned: 0 in 7.573s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e39f922-35b4-4168-a264-d066eda92573]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:11 devstack sudo[99592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:11 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:11 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.556s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:11 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.3fb6cb24-beba-4cdd-abb7-31622925e051alvsjbjk.img {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:00:11 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Converted 1024.00 MB image at 135.18 MB/s
Sep 20 17:00:11 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] 3fb6cb24-beba-4cdd-abb7-31622925e051 was raw, no need to convert to raw {{(pid=85945) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Flow 'volume_create_manager' (cff21ab8-953d-4402-a043-549d8471ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98814c6b-fe67-410d-9a42-947d28b93a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98814c6b-fe67-410d-9a42-947d28b93a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089801801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d3048a42-85f3-43f0-b474-2fca72c866cd,host='devstack@QuobyteHD#QuobyteHD',id=acb27e15-e4ea-4915-a317-931c0a0f2848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2452d7e72e448a9ff327c5e0bf2fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:00:13Z,use_quota=True,user_id='96d531ea757e425893a062c0d546f79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3347d14-fd2a-4708-8041-9ae963a8636e),volume_type_id=f3347d14-fd2a-4708-8041-9ae963a8636e)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09118778-5ee1-43b6-87c7-b3a4ac0a901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09118778-5ee1-43b6-87c7-b3a4ac0a901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2069124b-266e-48da-841d-bf4f39ed1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2069124b-266e-48da-841d-bf4f39ed1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb27e15-e4ea-4915-a317-931c0a0f2848', 'volume_name': 'volume-acb27e15-e4ea-4915-a317-931c0a0f2848', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a43626-be32-4167-97fb-b29e252b2f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a43626-be32-4167-97fb-b29e252b2f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30850d34-c004-4c0d-bd72-56b1f1719e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Volume acb27e15-e4ea-4915-a317-931c0a0f2848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb27e15-e4ea-4915-a317-931c0a0f2848', 'volume_size': 1}
Sep 20 17:00:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:22 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=51,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:00:22 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.458s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Uploaded volume to glance image-id: 3fb6cb24-beba-4cdd-abb7-31622925e051. {{(pid=85945) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.279s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d3048a42-85f3-43f0-b474-2fca72c866cd,created_at=2026-09-20T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089801801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d3048a42-85f3-43f0-b474-2fca72c866cd,host='devstack@QuobyteHD#QuobyteHD',id=acb27e15-e4ea-4915-a317-931c0a0f2848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2452d7e72e448a9ff327c5e0bf2fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:00:13Z,use_quota=True,user_id='96d531ea757e425893a062c0d546f79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3347d14-fd2a-4708-8041-9ae963a8636e),volume_type_id=f3347d14-fd2a-4708-8041-9ae963a8636e)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Creating volume acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:00:32 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:00:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:32 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 1073741824
Sep 20 17:00:32 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-41df84b5-e5ba-465c-a61c-b91e5abb6bab tempest-VolumesActionsTest-1370284008 None] Copy volume to image completed successfully.
Sep 20 17:00:33 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 1073741824" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:33 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:33 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:33 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30850d34-c004-4c0d-bd72-56b1f1719e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb27e15-e4ea-4915-a317-931c0a0f2848', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76de9144-6570-44cd-b32e-e4558efa3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:00:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Volume volume-acb27e15-e4ea-4915-a317-931c0a0f2848 (acb27e15-e4ea-4915-a317-931c0a0f2848): created successfully
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76de9144-6570-44cd-b32e-e4558efa3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:00:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Flow 'volume_create_manager' (cff21ab8-953d-4402-a043-549d8471ab92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:00:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e1ddd7c6-328e-4077-9d55-5e1b5c31a298 tempest-GroupsV314Test-2080111697 None] Created volume successfully.
Sep 20 17:00:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:34 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Cloning volume acb27e15-e4ea-4915-a317-931c0a0f2848 to volume a4903db5-9df9-4c98-bd88-3313a234650c
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Creating offline snapshot 532461ec-b20d-4a31-ae06-82ec79a1d906 of volume acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9acf220-c94e-4ebd-95ca-4fa15d14b024]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:35 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:35 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:35 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.493s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:35 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 1G
Sep 20 17:00:35 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:36 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 1G" returned: 0 in 0.453s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb27e15-e4ea-4915-a317-931c0a0f2848 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:36 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb27e15-e4ea-4915-a317-931c0a0f2848 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:36 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:36 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb27e15-e4ea-4915-a317-931c0a0f2848 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:36 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:36 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:36 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:36 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.327s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:36 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info
Sep 20 17:00:36 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:37 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:37 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:37 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info
Sep 20 17:00:37 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:37 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.info" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Acquiring lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] snapshot: 532461ec-b20d-4a31-ae06-82ec79a1d906, volume: a4903db5-9df9-4c98-bd88-3313a234650c,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f49785-21f0-45da-b967-5902c0dcc34a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:37 devstack sudo[99638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:37 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:37 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acb27e15-e4ea-4915-a317-931c0a0f2848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4ac97-037e-49d9-9e82-93eed0d1b5a1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:37 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:37 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:38 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:38 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:00:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:38 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c
Sep 20 17:00:38 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:45 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c" returned: 0 in 7.246s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e797f5c-11ed-428c-913d-f0bb12b1d849]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:45 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:45 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:46 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.532s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:00:46 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Converted 1024.00 MB image at 141.29 MB/s
Sep 20 17:00:46 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c is being set with open permissions: ugo+rw: NotImplementedError
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:46 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c
Sep 20 17:00:46 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:46 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" released by "_copy_volume_from_snapshot" :: held 8.936s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Acquiring lock "cinder-quobyte-532461ec-b20d-4a31-ae06-82ec79a1d906" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-532461ec-b20d-4a31-ae06-82ec79a1d906" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Deleting offline snapshot 532461ec-b20d-4a31-ae06-82ec79a1d906 of volume acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] snapshot_file for this snap is: volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[857753e7-dbe5-425d-897e-83d7fc0c9a8e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:46 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:46 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:00:46 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.412s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acb27e15-e4ea-4915-a317-931c0a0f2848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a56f531-3c46-4dd5-b0c3-d273634a7f36]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:46 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:46 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:47 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:47 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:47 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:47 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:47 devstack sudo[99691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906
Sep 20 17:00:47 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:48 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848.532461ec-b20d-4a31-ae06-82ec79a1d906" returned: 0 in 0.291s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-532461ec-b20d-4a31-ae06-82ec79a1d906" released by "_delete_snapshot" :: held 1.722s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.118s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 12.678s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda4c69f-cff4-44a9-b8e2-9970a1f51ef9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-50812eed-604d-46f7-80f3-54a2e44652e0 tempest-GroupsV314Test-2080111697 None] Create group from source-group-d3048a42-85f3-43f0-b474-2fca72c866cd completed successfully.
Sep 20 17:00:48 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:48 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:48 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.523s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a7e2d-eb6b-4910-bf93-9ec707d31c28]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:48 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:48 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:49 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.427s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:49 devstack sudo[99720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img
Sep 20 17:00:49 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Acquiring lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f87d8-c901-402e-926a-aa279e64e6db]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:49 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c
Sep 20 17:00:49 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:50 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c" returned: 0 in 0.893s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:50 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c
Sep 20 17:00:50 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:51 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a4903db5-9df9-4c98-bd88-3313a234650c" returned: 0 in 0.939s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-a4903db5-9df9-4c98-bd88-3313a234650c" released by "delete_volume" :: held 1.905s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Created reservations ['483d2e1b-2ceb-4049-8751-356ca1870daf'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:00:51 devstack cinder-volume[85945]: WARNING cinder.quota [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-21026958 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-21026958, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:00:51 devstack cinder-volume[85945]: WARNING cinder.quota [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-21026958 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-21026958, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Created reservations ['d69e81cc-8664-4f84-bb51-076c85c75e57', '8ef2e5ad-c2a0-4e25-9069-7b0381390cce', '7a5d2d27-3168-4761-8409-1bca0dffdc3a', '8d84ca33-e916-43cb-8ddd-249a16cab1e5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:52 devstack sudo[99780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:00:52 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:52 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.607s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:52 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:00:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-75a8cf5a-3bed-48dc-a1b4-c7d399496636 tempest-GroupsV314Test-2080111697 None] Delete group completed successfully.
Sep 20 17:00:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Acquiring lock "cinder-quobyte-acb27e15-e4ea-4915-a317-931c0a0f2848" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:00:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-acb27e15-e4ea-4915-a317-931c0a0f2848" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:00:53 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[40289fdc-21ca-43b1-b9c6-9636b5d30438]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:53 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:53 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:54 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 1.192s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:54 devstack sudo[99856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848
Sep 20 17:00:54 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:55 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-acb27e15-e4ea-4915-a317-931c0a0f2848" returned: 0 in 0.814s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Lock "cinder-quobyte-acb27e15-e4ea-4915-a317-931c0a0f2848" released by "delete_volume" :: held 2.321s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:00:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Created reservations ['5aa23652-c1a0-45e7-b938-22f8f27568af'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:00:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Created reservations ['423f3179-5173-4395-827f-317bb0b07aa5', '2e9c4f34-bedc-4160-b165-bc8cbafff74d', '62c7457a-1bd1-412d-9df0-f513b843e4d5', 'e486c830-3020-4247-9182-3c5af60cce90'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:56 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:00:56 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:56 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.453s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:56 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:00:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c6ee6888-b048-47f1-a114-abc5fb15abaa tempest-GroupsV314Test-2080111697 None] Delete group completed successfully.
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:00:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:58 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:00:58 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:00:59 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:59 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 1.149s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img" returned: 0 in 10.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f829e-675f-4ad8-844c-7806ba2dc655]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:00:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:00:59 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:00:59 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:00 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.942s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896, size 1024.00 MB, duration 10.40 sec, destination /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:01:00 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Converted 1024.00 MB image at 98.49 MB/s
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] 1a44d788-1dd0-497e-9b84-13b36c986e21 was raw, converting to qcow2 {{(pid=85945) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbce0ac-c572-44f0-8841-cf0ce19bf84d]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:00 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img
Sep 20 17:01:00 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:00 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:01 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img
Sep 20 17:01:01 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:01 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img" returned: 1 in 0.455s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:01 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv
Sep 20 17:01:01 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:01 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Image conversion details: src /opt/stack/data/cinder/conversion/b77d391f-3c49-4f73-ba4f-03dc7c3ac896.temp_image.1a44d788-1dd0-497e-9b84-13b36c986e210xlivl9b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:01:01 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4664d6e-b236-4912-87d6-db850c8ba41a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:01 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv
Sep 20 17:01:01 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:02 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oht4k_qv" returned: 0 in 0.373s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.022s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Uploaded volume to glance image-id: 1a44d788-1dd0-497e-9b84-13b36c986e21. {{(pid=85945) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 20 17:01:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-964a0b67-4b3b-4b34-90b8-4e0deac2d199 tempest-VolumesActionsTest-1370284008 None] Copy volume to image completed successfully.
Sep 20 17:01:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ae97cf30-88f4-4083-8cb8-ea6c2a1b7919 tempest-GroupsV320Test-61923367 None] Group tempest-GroupsV320Test-Group-845626000: creating
Sep 20 17:01:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ae97cf30-88f4-4083-8cb8-ea6c2a1b7919 tempest-GroupsV320Test-61923367 None] Group tempest-GroupsV320Test-Group-845626000: created successfully
Sep 20 17:01:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ae97cf30-88f4-4083-8cb8-ea6c2a1b7919 tempest-GroupsV320Test-61923367 None] Create group completed successfully.
Sep 20 17:01:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "cinder-quobyte-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-quobyte-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0a56c-4c1f-47c4-a5fb-7545d82e3765]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:06 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:01:06 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:06 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.422s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:06 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896
Sep 20 17:01:06 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:06 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-quobyte-b77d391f-3c49-4f73-ba4f-03dc7c3ac896" released by "delete_volume" :: held 0.805s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Created reservations ['10ca20d7-08f7-4b0a-8408-bbfe57303164', 'f5a84ed0-011a-4341-bd01-fe5a372d4f97', 'c3b113fe-8101-45b3-bed0-8f7af57ed22b', 'f086afba-9649-4571-994f-1d955beb21c7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:07 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:07 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Created reservations ['01f65bd0-d2f6-41f5-af1f-48a55b6dfa43'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:07 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:07 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Deleted volume successfully.
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-67376b01-0f22-4fee-b151-6dc47fe2ec65 tempest-VolumesActionsTest-1370284008 None] Lock "cinder-b77d391f-3c49-4f73-ba4f-03dc7c3ac896-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:07 devstack sudo[99912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:07 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:07 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:07 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:07 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a1b9e9ff-7910-45ec-8230-bfeb9bed0a9f tempest-GroupsV320Test-61923367 None] Delete group completed successfully.
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Flow 'volume_create_manager' (c7d6636a-f442-4fa7-9be8-2feb758c6c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c530217-23b2-4750-a262-8532e45fa7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c530217-23b2-4750-a262-8532e45fa7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-902588854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31f5118-ba0a-424a-8152-4a7ebe5196bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7693c37448b345029b2bc1d79146c24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:16Z,use_quota=True,user_id='404725996b50489a98c2a6a46c4158c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68404a8-bde7-499b-bf8d-08f47dc6acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68404a8-bde7-499b-bf8d-08f47dc6acf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d10ba1e-a5de-43ff-be65-05c55982da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d10ba1e-a5de-43ff-be65-05c55982da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31f5118-ba0a-424a-8152-4a7ebe5196bb', 'volume_name': 'volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb', 'volume_size': 2}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3771fb-6e8e-4a39-9f0a-8d9f87b811d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3771fb-6e8e-4a39-9f0a-8d9f87b811d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f906b6-8956-4d58-aa82-91ec69596529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Volume b31f5118-ba0a-424a-8152-4a7ebe5196bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb', 'volume_size': 2}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-902588854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31f5118-ba0a-424a-8152-4a7ebe5196bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7693c37448b345029b2bc1d79146c24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:16Z,use_quota=True,user_id='404725996b50489a98c2a6a46c4158c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Creating volume b31f5118-ba0a-424a-8152-4a7ebe5196bb {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:15 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb 2147483648 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:15 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb 2147483648
Sep 20 17:01:15 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:16 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb 2147483648" returned: 0 in 0.605s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:16 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb
Sep 20 17:01:16 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:16 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb" returned: 0 in 0.268s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f906b6-8956-4d58-aa82-91ec69596529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb', 'volume_size': 2}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d5bcd1-ffc7-420b-8ac4-59c48c5eea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Volume volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb (b31f5118-ba0a-424a-8152-4a7ebe5196bb): created successfully
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d5bcd1-ffc7-420b-8ac4-59c48c5eea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Flow 'volume_create_manager' (c7d6636a-f442-4fa7-9be8-2feb758c6c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5372879e-6eda-4965-b8e2-782501263aa4 tempest-VolumesCloneNegativeTest-441884166 None] Created volume successfully.
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Acquiring lock "cinder-b31f5118-ba0a-424a-8152-4a7ebe5196bb-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "cinder-b31f5118-ba0a-424a-8152-4a7ebe5196bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Acquiring lock "cinder-quobyte-b31f5118-ba0a-424a-8152-4a7ebe5196bb" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "cinder-quobyte-b31f5118-ba0a-424a-8152-4a7ebe5196bb" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7596891-6957-419d-b440-cfd61054bcd6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:18 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb
Sep 20 17:01:18 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:18 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:18 devstack sudo[99947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb
Sep 20 17:01:18 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:18 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b31f5118-ba0a-424a-8152-4a7ebe5196bb" returned: 0 in 0.268s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "cinder-quobyte-b31f5118-ba0a-424a-8152-4a7ebe5196bb" released by "delete_volume" :: held 0.728s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Created reservations ['4eec9fbf-c9cf-44e7-ac8b-8f07f0212377', 'c561c264-9754-4a2d-93fc-631f31517cd8', 'deee17a4-3b90-4576-8102-26b32578ae49', 'f019d5a6-aab0-4d12-a53f-7895f5878465'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:18 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:18 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:19 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:19 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Deleted volume successfully.
Sep 20 17:01:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-672d0b9a-538d-4954-8542-18127a22e1eb tempest-VolumesCloneNegativeTest-441884166 None] Lock "cinder-b31f5118-ba0a-424a-8152-4a7ebe5196bb-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:20 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Flow 'volume_create_manager' (ac4619d8-171c-4d33-bbda-b9c43cf931d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6b1ad1-e129-4958-97a1-1593b71c2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6b1ad1-e129-4958-97a1-1593b71c2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-873825521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93730d11c4304633b5fcad577fef8d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:21Z,use_quota=True,user_id='c82dfa1bb78c490ca90ea81de678f17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea320ed-2265-4dd9-9598-e2369ce631d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea320ed-2265-4dd9-9598-e2369ce631d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8604e1a9-87ff-4504-aa34-e8a1fa898cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8604e1a9-87ff-4504-aa34-e8a1fa898cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11', 'volume_name': 'volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b97b28-e961-4240-9f12-97111d99b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b97b28-e961-4240-9f12-97111d99b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204b1f80-abc8-433a-91f7-2ee0f969aaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Volume be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11', 'volume_size': 1}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-873825521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93730d11c4304633b5fcad577fef8d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:21Z,use_quota=True,user_id='c82dfa1bb78c490ca90ea81de678f17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Creating volume be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:21 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 1073741824
Sep 20 17:01:21 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:21 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 1073741824" returned: 0 in 0.495s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:21 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11
Sep 20 17:01:21 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:21 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204b1f80-abc8-433a-91f7-2ee0f969aaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5256018d-a6cf-42f3-8d30-c6998c830d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Volume volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 (be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11): created successfully
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5256018d-a6cf-42f3-8d30-c6998c830d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Flow 'volume_create_manager' (ac4619d8-171c-4d33-bbda-b9c43cf931d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-55f7b482-c41a-4bde-bb9f-b8a0a2742b56 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Created volume successfully.
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (fc9ad8f4-4c69-437a-9f05-45eabf8e2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa560159-ed32-424f-aa90-7bdcf170aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa560159-ed32-424f-aa90-7bdcf170aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868644959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4198f3f6-8d42-4ff1-a343-7472b57fa0ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:23Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e72b5-a715-4308-ad4d-b2e4b65cddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e72b5-a715-4308-ad4d-b2e4b65cddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33729c8a-e3b6-4956-ae08-849cf0004d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33729c8a-e3b6-4956-ae08-849cf0004d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4198f3f6-8d42-4ff1-a343-7472b57fa0ae', 'volume_name': 'volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119353c0-c481-4fff-88a5-fc7af12e9e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119353c0-c481-4fff-88a5-fc7af12e9e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b648dc91-ecc7-4c8d-819f-8efb35c7e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Volume 4198f3f6-8d42-4ff1-a343-7472b57fa0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae', 'volume_size': 1}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868644959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4198f3f6-8d42-4ff1-a343-7472b57fa0ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:23Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Creating volume 4198f3f6-8d42-4ff1-a343-7472b57fa0ae {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:23 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:23 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae 1073741824
Sep 20 17:01:23 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:23 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae 1073741824" returned: 0 in 0.440s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:23 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae
Sep 20 17:01:23 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:24 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.369s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b648dc91-ecc7-4c8d-819f-8efb35c7e03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c4a24b-798e-48fc-b628-749a9709fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c02331-3dc7-4b2b-805d-7f41e77e3688]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Volume volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae (4198f3f6-8d42-4ff1-a343-7472b57fa0ae): created successfully
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c4a24b-798e-48fc-b628-749a9709fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (fc9ad8f4-4c69-437a-9f05-45eabf8e2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-79b3b4a5-f895-4164-9d2d-cd73fa00a1b4 tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:01:24 devstack sudo[99986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11
Sep 20 17:01:24 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:24 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.410s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e7b7a3f-9071-4552-90ce-60f12aaf7f6d', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:01:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-16029774-4fd9-424d-8bbd-63812919a5cc req-70f957de-0730-43cf-b568-d1302186d8ef tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] attachment_update completed successfully.
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (f61edb5d-12e2-4ef4-8d55-646daebc260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e68ff84-6c29-4e83-846c-d9bb6895fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e68ff84-6c29-4e83-846c-d9bb6895fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1159100882',display_name='tempest-VolumesGetTest-Volume-1156564686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7809c3c8-1f4b-42bb-8251-85649de7e6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:26Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0074d8ab-3621-4dae-9127-cc2a3674c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0074d8ab-3621-4dae-9127-cc2a3674c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9fa74-ffb7-4be2-865c-39deb71cb7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9fa74-ffb7-4be2-865c-39deb71cb7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7809c3c8-1f4b-42bb-8251-85649de7e6f8', 'volume_name': 'volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8794dcc-98ad-4294-8a8d-05fab0cd2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8794dcc-98ad-4294-8a8d-05fab0cd2d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c23247d-4d70-4931-b64f-5314303e2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:26 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Volume 7809c3c8-1f4b-42bb-8251-85649de7e6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8', 'volume_size': 1}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1159100882',display_name='tempest-VolumesGetTest-Volume-1156564686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7809c3c8-1f4b-42bb-8251-85649de7e6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:26Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Creating volume 7809c3c8-1f4b-42bb-8251-85649de7e6f8 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:26 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:26 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 1073741824
Sep 20 17:01:26 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:26 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 1073741824" returned: 0 in 0.491s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:26 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8
Sep 20 17:01:26 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:27 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c23247d-4d70-4931-b64f-5314303e2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8015a984-c6e3-4ddd-83d7-dbc60fb64b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Volume volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 (7809c3c8-1f4b-42bb-8251-85649de7e6f8): created successfully
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8015a984-c6e3-4ddd-83d7-dbc60fb64b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (f61edb5d-12e2-4ef4-8d55-646daebc260e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d41ab48a-ec98-4286-927b-3a29900cbb5f tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:01:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-2c73dd72-1da5-44e0-b42c-ef39f35dc72c req-f42c70ac-a35c-4683-ab89-04a472f9be08 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Terminate volume connection completed successfully.
Sep 20 17:01:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-2c73dd72-1da5-44e0-b42c-ef39f35dc72c req-f42c70ac-a35c-4683-ab89-04a472f9be08 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Deleting attachment 4e7b7a3f-9071-4552-90ce-60f12aaf7f6d. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-7809c3c8-1f4b-42bb-8251-85649de7e6f8-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "cinder-7809c3c8-1f4b-42bb-8251-85649de7e6f8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-7809c3c8-1f4b-42bb-8251-85649de7e6f8" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-7809c3c8-1f4b-42bb-8251-85649de7e6f8" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b40abd-06c6-4d08-9bd6-c313bd05c193]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "cinder-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "cinder-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "cinder-quobyte-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:28 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8
Sep 20 17:01:28 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "cinder-quobyte-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8ecb84-2dc9-41a3-9a4a-7f642f9a2535]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:28 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11
Sep 20 17:01:28 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:28 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:28 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8
Sep 20 17:01:28 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:29 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" returned: 0 in 0.458s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:29 devstack sudo[100453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11
Sep 20 17:01:29 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:29 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7809c3c8-1f4b-42bb-8251-85649de7e6f8" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-7809c3c8-1f4b-42bb-8251-85649de7e6f8" released by "delete_volume" :: held 0.763s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Created reservations ['5b5dd820-9b57-46e0-80a8-232341716ed0', 'ddece2db-cff5-46fd-a350-a07731de3af2', '10f5b5c9-7249-420e-80eb-4ab757779c4b', '75f685e7-671d-4612-a964-acd95f38f48f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:29 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:29 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:29 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "cinder-quobyte-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11" released by "delete_volume" :: held 0.797s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Created reservations ['362e5bbb-9474-46f2-b9ee-7eb0b130a20f', '25e9234c-a6e1-4045-b01b-3c010ffda5ec', '5e9b80d3-0d81-420f-8394-bff34645c05c', '8822f72b-f52c-459d-b66d-11fdb65e8b61'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:29 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:29 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:29 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-4198f3f6-8d42-4ff1-a343-7472b57fa0ae-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.375s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:29 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "cinder-4198f3f6-8d42-4ff1-a343-7472b57fa0ae-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-af9467dd-bb99-457c-b1a4-4872695a466a tempest-VolumesGetTest-1862417126 None] Lock "cinder-7809c3c8-1f4b-42bb-8251-85649de7e6f8-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b4a02c-9abb-4d1c-a87d-11430b54ece7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:29 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.406s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:29 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:29 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Deleted volume successfully.
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27a9f325-cbac-44af-a015-6013322035d1 tempest-TestServerVolumeAttachScenarioOldVersion-1200343293 None] Lock "cinder-be9ed9ac-2d73-4f4a-99db-d3ba7d3fdc11-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:30 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae
Sep 20 17:01:30 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:30 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" returned: 0 in 0.622s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:30 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae
Sep 20 17:01:30 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:30 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" returned: 0 in 0.313s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-4198f3f6-8d42-4ff1-a343-7472b57fa0ae" released by "delete_volume" :: held 1.002s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:30 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Created reservations ['a5a61620-cd37-4baa-9681-9fa3abd11fd4', '4112a419-1b70-4b9c-9e0b-d43302f0bacd', '59f9f541-9793-4d73-b43c-ef5066861bc4', '8713278f-892e-4cf1-91e8-045d65428427'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:31 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:31 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:31 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.293s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:01:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6f519143-eb58-409d-932a-dbaac92580b1 tempest-VolumesGetTest-1862417126 None] Lock "cinder-4198f3f6-8d42-4ff1-a343-7472b57fa0ae-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (2281e8a8-ed28-4b67-9cbf-594fe83c196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb407ab-4565-4887-a6e8-b8dd71104ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=8,cinder:SELECT=62 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb407ab-4565-4887-a6e8-b8dd71104ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2068269987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65f35e8-26b9-41dd-a42e-e7b6ca954278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:33Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69950ba2-b860-476c-86ae-1b466bf6b487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69950ba2-b860-476c-86ae-1b466bf6b487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac4daa4-c7d0-41e8-bf28-25b24d257653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac4daa4-c7d0-41e8-bf28-25b24d257653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'volume_name': 'volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230d27a8-9058-4157-a8b7-a3404bf9f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230d27a8-9058-4157-a8b7-a3404bf9f57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba177d88-57f5-451e-aadd-88d76d548dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Volume b65f35e8-26b9-41dd-a42e-e7b6ca954278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'volume_size': 1}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2068269987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65f35e8-26b9-41dd-a42e-e7b6ca954278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:33Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Creating volume b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:32 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:32 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 1073741824
Sep 20 17:01:32 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:33 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 1073741824" returned: 0 in 0.579s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:33 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:33 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:33 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba177d88-57f5-451e-aadd-88d76d548dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95ab9ab-68e4-4772-b316-5642c4d0dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Volume volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 (b65f35e8-26b9-41dd-a42e-e7b6ca954278): created successfully
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95ab9ab-68e4-4772-b316-5642c4d0dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (2281e8a8-ed28-4b67-9cbf-594fe83c196f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0558cb15-542d-46c8-ad43-fa48f7de90f6 tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (49712f33-a4a4-4d67-ae88-0a364512ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73128c2d-69e0-42e3-979e-aa730871147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73128c2d-69e0-42e3-979e-aa730871147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037310120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef3ca8c-522d-46cd-898b-5eabe8de74e7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b65f35e8-26b9-41dd-a42e-e7b6ca954278,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:35Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158cc50b-ea98-4d1d-b26e-92d622915f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158cc50b-ea98-4d1d-b26e-92d622915f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3051a4f-419a-45fa-a948-90902c03b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3051a4f-419a-45fa-a948-90902c03b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6ef3ca8c-522d-46cd-898b-5eabe8de74e7', 'volume_name': 'volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7', 'volume_size': 1, 'source_volid': 'b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'source_volstatus': 'available'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c230a4e7-569e-46a8-89ee-9322e4b6a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c230a4e7-569e-46a8-89ee-9322e4b6a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06f6e49-a60e-44fe-b73e-f391b9f85028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:35 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Volume 6ef3ca8c-522d-46cd-898b-5eabe8de74e7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7', 'volume_size': 1, 'source_volid': 'b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'source_volstatus': 'available'}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:35 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Cloning volume b65f35e8-26b9-41dd-a42e-e7b6ca954278 to volume 6ef3ca8c-522d-46cd-898b-5eabe8de74e7
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Creating offline snapshot 9006a39c-9c2a-4848-bb96-7b710f63025b of volume b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[82966403-1b6e-4a88-a069-06f381b8a347]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:35 devstack sudo[100512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:35 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:35 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:35 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b 1G
Sep 20 17:01:35 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:36 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b 1G" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:36 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:36 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:36 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:36 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b is being set with open permissions: ugo+rw
Sep 20 17:01:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:36 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:36 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:37 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.285s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:37 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info
Sep 20 17:01:37 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:37 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info" returned: 0 in 0.266s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:37 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info is being set with open permissions: ugo+rw
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:37 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info
Sep 20 17:01:37 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:37 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.info" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] snapshot: 9006a39c-9c2a-4848-bb96-7b710f63025b, volume: 6ef3ca8c-522d-46cd-898b-5eabe8de74e7,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[63012714-9c35-4961-951f-dc5e2b0166fd]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:37 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:37 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:38 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff64e2-d1ff-4dac-a254-98ebdd0237b1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:38 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:38 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:38 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:01:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:38 devstack sudo[100547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7
Sep 20 17:01:38 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:47 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" returned: 0 in 8.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d13082-8def-4ba9-a4e8-77a05480600f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=82,cinder:SELECT=81,cinder:INSERT=19,cinder:DELETE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:01:47 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:47 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:47 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.555s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:01:47 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Converted 1024.00 MB image at 121.73 MB/s
Sep 20 17:01:47 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 is being set with open permissions: ugo+rw
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:47 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7
Sep 20 17:01:47 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:47 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" returned: 0 in 0.282s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" released by "_copy_volume_from_snapshot" :: held 10.152s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-9006a39c-9c2a-4848-bb96-7b710f63025b" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-9006a39c-9c2a-4848-bb96-7b710f63025b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Deleting offline snapshot 9006a39c-9c2a-4848-bb96-7b710f63025b of volume b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] snapshot_file for this snap is: volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0649a-68e9-41c6-b274-e2143abf90b7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:48 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:48 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:48 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.437s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae6a72-f946-4d2d-b68c-8f03eb00e486]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:48 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:48 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:48 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.398s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:48 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:48 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:49 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.406s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:49 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b
Sep 20 17:01:49 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:49 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278.9006a39c-9c2a-4848-bb96-7b710f63025b" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-9006a39c-9c2a-4848-bb96-7b710f63025b" released by "_delete_snapshot" :: held 1.641s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.195s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06f6e49-a60e-44fe-b73e-f391b9f85028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7', 'volume_size': 1, 'source_volid': 'b65f35e8-26b9-41dd-a42e-e7b6ca954278', 'source_volstatus': 'available'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8217e341-e24e-43bb-9c33-f3e3bfe144ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Volume volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 (6ef3ca8c-522d-46cd-898b-5eabe8de74e7): created successfully
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8217e341-e24e-43bb-9c33-f3e3bfe144ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (49712f33-a4a4-4d67-ae88-0a364512ef51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c6655676-204f-4954-8d54-1b231662b87d tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (825dc203-d5d2-4b46-b75d-50644fee16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1704ff88-029f-41ed-a6fc-f6d25c8ca808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1704ff88-029f-41ed-a6fc-f6d25c8ca808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079542219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9316c50-e09d-4cbe-9250-a0e3c3fb9159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:51Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2ea6fb-3ec2-40bf-a326-66e7b846745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2ea6fb-3ec2-40bf-a326-66e7b846745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd322059-986b-4710-be61-234b5dfc1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd322059-986b-4710-be61-234b5dfc1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9316c50-e09d-4cbe-9250-a0e3c3fb9159', 'volume_name': 'volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38e29eb-114d-4e2b-86c1-14ef38c27630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38e29eb-114d-4e2b-86c1-14ef38c27630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1548d197-eab3-4d73-b14a-8febfca96885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Volume c9316c50-e09d-4cbe-9250-a0e3c3fb9159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159', 'volume_size': 1}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079542219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9316c50-e09d-4cbe-9250-a0e3c3fb9159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:51Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Creating volume c9316c50-e09d-4cbe-9250-a0e3c3fb9159 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:50 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:50 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 1073741824
Sep 20 17:01:50 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (491e8d32-3894-4081-93f3-9823ac779f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57163ab5-6d8d-4869-9e68-c7a422dc08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57163ab5-6d8d-4869-9e68-c7a422dc08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401688363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60547b01-734f-4518-81c5-07a2f9dd9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:51Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b80ec35-cf69-4279-96b7-8addbe49b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b80ec35-cf69-4279-96b7-8addbe49b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae446f68-296f-482b-9c21-587df44a851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae446f68-296f-482b-9c21-587df44a851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60547b01-734f-4518-81c5-07a2f9dd9ba1', 'volume_name': 'volume-60547b01-734f-4518-81c5-07a2f9dd9ba1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0a15bb-928e-4ba1-b0e8-1f0c1a6761d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0a15bb-928e-4ba1-b0e8-1f0c1a6761d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126843d1-1483-4c17-ab9b-fc22dcb6e0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Volume 60547b01-734f-4518-81c5-07a2f9dd9ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60547b01-734f-4518-81c5-07a2f9dd9ba1', 'volume_size': 1}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:51 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 1073741824" returned: 0 in 0.817s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:51 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159
Sep 20 17:01:51 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (d6aaed54-d9f0-49b1-baf2-2e93c0b3afc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634c20f3-4c3d-472f-bc8f-41a4a6182a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634c20f3-4c3d-472f-bc8f-41a4a6182a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905856246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c167f9-9e5b-441f-b9cb-ef24b91f414f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e69836-86b1-4a69-9cc1-393c679bc782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e69836-86b1-4a69-9cc1-393c679bc782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f68721-7ff5-426f-b416-700c7947de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f68721-7ff5-426f-b416-700c7947de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c167f9-9e5b-441f-b9cb-ef24b91f414f', 'volume_name': 'volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33ba2a5-f646-4eb4-bf16-519c2f7a676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33ba2a5-f646-4eb4-bf16-519c2f7a676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0444444-e0b3-4589-9f62-877e5bf79cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Volume 58c167f9-9e5b-441f-b9cb-ef24b91f414f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f', 'volume_size': 1}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:51 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" returned: 0 in 0.325s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401688363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60547b01-734f-4518-81c5-07a2f9dd9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:51Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Creating volume 60547b01-734f-4518-81c5-07a2f9dd9ba1 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:52 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 1073741824
Sep 20 17:01:52 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (0bebfe36-718a-495f-9584-1ceb0a3cd635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620d8f1d-0a5e-40f4-b953-a3df845b29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1548d197-eab3-4d73-b14a-8febfca96885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7ca789-2b4a-4301-a69a-01f753a65097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620d8f1d-0a5e-40f4-b953-a3df845b29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026261418',display_name='tempest-VolumesGetTest-Volume-485197500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c978c87-9a78-4572-ba4a-6d4e36d0dde0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956713f-449e-4b64-9ffa-b187365e421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956713f-449e-4b64-9ffa-b187365e421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d55e6a-7911-40a5-af5b-97fbc4f70843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d55e6a-7911-40a5-af5b-97fbc4f70843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c978c87-9a78-4572-ba4a-6d4e36d0dde0', 'volume_name': 'volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe94e88-7c78-4de1-a491-fba8940eb6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe94e88-7c78-4de1-a491-fba8940eb6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f17592-49fe-4bf2-a290-3b62ee310fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Volume 3c978c87-9a78-4572-ba4a-6d4e36d0dde0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0', 'volume_size': 1}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Volume volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 (c9316c50-e09d-4cbe-9250-a0e3c3fb9159): created successfully
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7ca789-2b4a-4301-a69a-01f753a65097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (825dc203-d5d2-4b46-b75d-50644fee16e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (b455680f-1ce8-48ad-9147-56a3a8166baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ce682f-2848-402b-9c62-d20b24da3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7a02553f-2699-4db4-8da8-02c3ebf21632 tempest-CreateVolumesFromImageTest-1365348142 None] Created volume successfully.
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ce682f-2848-402b-9c62-d20b24da3fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446372536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf79d6-fb59-4008-9390-8ece6ba8f3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909d1c31-4682-4d37-bf0b-1b6a031af6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909d1c31-4682-4d37-bf0b-1b6a031af6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d0883b-3d17-4177-a034-8c9569d8dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d0883b-3d17-4177-a034-8c9569d8dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bf79d6-fb59-4008-9390-8ece6ba8f3a7', 'volume_name': 'volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7376e132-b58c-4b4b-b108-8cdd9c2a1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7376e132-b58c-4b4b-b108-8cdd9c2a1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51063cc6-144b-4ace-a5d7-29aaf9ddd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Volume 71bf79d6-fb59-4008-9390-8ece6ba8f3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7', 'volume_size': 1}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (da72b750-dd7a-41ac-bc15-9161f6aef5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcb276e-037c-457d-9830-ef2f7265b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcb276e-037c-457d-9830-ef2f7265b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-465498428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b982042d-ec8e-4491-a5cd-66dec2c27310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:53Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1015ba39-3855-4c7e-b472-dc12f85226fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1015ba39-3855-4c7e-b472-dc12f85226fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a414cb0-3ce1-4915-9bab-fdb5ae599ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a414cb0-3ce1-4915-9bab-fdb5ae599ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b982042d-ec8e-4491-a5cd-66dec2c27310', 'volume_name': 'volume-b982042d-ec8e-4491-a5cd-66dec2c27310', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb6788a-78b7-4287-b055-4670724f4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb6788a-78b7-4287-b055-4670724f4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915df029-e7d3-490c-9193-939cd33620b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Volume b982042d-ec8e-4491-a5cd-66dec2c27310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b982042d-ec8e-4491-a5cd-66dec2c27310', 'volume_size': 1}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 1073741824" returned: 0 in 0.723s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:52 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1
Sep 20 17:01:52 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:53 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1" returned: 0 in 0.264s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905856246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c167f9-9e5b-441f-b9cb-ef24b91f414f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Creating volume 58c167f9-9e5b-441f-b9cb-ef24b91f414f {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126843d1-1483-4c17-ab9b-fc22dcb6e0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60547b01-734f-4518-81c5-07a2f9dd9ba1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb40f27-472c-4787-b04b-4939c319f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:53 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f 1073741824
Sep 20 17:01:53 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Volume volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 (60547b01-734f-4518-81c5-07a2f9dd9ba1): created successfully
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb40f27-472c-4787-b04b-4939c319f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (491e8d32-3894-4081-93f3-9823ac779f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1321b4b7-a134-45d9-9d07-1a2ebda7f294 tempest-CreateVolumesFromImageTest-1365348142 None] Created volume successfully.
Sep 20 17:01:53 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f 1073741824" returned: 0 in 0.449s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:53 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f
Sep 20 17:01:53 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:53 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f" returned: 0 in 0.291s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026261418',display_name='tempest-VolumesGetTest-Volume-485197500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c978c87-9a78-4572-ba4a-6d4e36d0dde0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Creating volume 3c978c87-9a78-4572-ba4a-6d4e36d0dde0 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0444444-e0b3-4589-9f62-877e5bf79cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:53 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 1073741824
Sep 20 17:01:53 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa425a7-d691-4d48-9ef4-37f177a58585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Volume volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f (58c167f9-9e5b-441f-b9cb-ef24b91f414f): created successfully
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa425a7-d691-4d48-9ef4-37f177a58585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (d6aaed54-d9f0-49b1-baf2-2e93c0b3afc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dd64f246-39ba-4499-bf10-bef6f02fb32f tempest-CreateVolumesFromImageTest-1365348142 None] Created volume successfully.
Sep 20 17:01:54 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 1073741824" returned: 0 in 0.477s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:54 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0
Sep 20 17:01:54 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:54 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" returned: 0 in 0.240s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446372536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf79d6-fb59-4008-9390-8ece6ba8f3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:52Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Creating volume 71bf79d6-fb59-4008-9390-8ece6ba8f3a7 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:54 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f17592-49fe-4bf2-a290-3b62ee310fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:54 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 1073741824
Sep 20 17:01:54 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa4b4be-4dc3-4de7-8877-d41052e5e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Volume volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 (3c978c87-9a78-4572-ba4a-6d4e36d0dde0): created successfully
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa4b4be-4dc3-4de7-8877-d41052e5e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (0bebfe36-718a-495f-9584-1ceb0a3cd635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bb50aefa-03b7-4e21-9077-769821e1bd70 tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-3c978c87-9a78-4572-ba4a-6d4e36d0dde0-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "cinder-3c978c87-9a78-4572-ba4a-6d4e36d0dde0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ed2ad-669a-4b49-b1a7-dfbe598e235f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:55 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 1073741824" returned: 0 in 0.548s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:55 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7
Sep 20 17:01:55 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:55 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0
Sep 20 17:01:55 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:55 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-465498428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b982042d-ec8e-4491-a5cd-66dec2c27310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b76476de524dcdb3d7670499eed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:53Z,use_quota=True,user_id='7f461dd104dd43df9bc01c74da542a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Creating volume b982042d-ec8e-4491-a5cd-66dec2c27310 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:55 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51063cc6-144b-4ace-a5d7-29aaf9ddd29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b168c72-19b7-4bfc-8a55-3592ced0f81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:55 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 1073741824
Sep 20 17:01:55 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Volume volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 (71bf79d6-fb59-4008-9390-8ece6ba8f3a7): created successfully
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b168c72-19b7-4bfc-8a55-3592ced0f81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (b455680f-1ce8-48ad-9147-56a3a8166baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-88ec5488-478e-47cf-8975-cb5a6f987c2b tempest-CreateVolumesFromImageTest-1365348142 None] Created volume successfully.
Sep 20 17:01:55 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:55 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0
Sep 20 17:01:55 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:55 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" returned: 0 in 0.287s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-3c978c87-9a78-4572-ba4a-6d4e36d0dde0" released by "delete_volume" :: held 0.750s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Created reservations ['8b4b4382-db12-4fdb-b3b6-33b9b30eb257', '0f43faa6-acbb-46ea-bfef-33d5e064c373', '2354c4b4-c787-4ab2-bf95-b36c927e9b07', '2eacbd5b-9a89-42f0-b636-16971f091b3c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:56 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 1073741824" returned: 0 in 0.544s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:56 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:56 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:56 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310
Sep 20 17:01:56 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:56 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-6ef3ca8c-522d-46cd-898b-5eabe8de74e7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bc109b6e-4e4d-4510-b828-63d9ef8aff6e tempest-VolumesGetTest-1862417126 None] Lock "cinder-3c978c87-9a78-4572-ba4a-6d4e36d0dde0-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:56 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "cinder-6ef3ca8c-522d-46cd-898b-5eabe8de74e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915df029-e7d3-490c-9193-939cd33620b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b982042d-ec8e-4491-a5cd-66dec2c27310', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be4de4-9d14-4dcb-b9cb-766d76ad61af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Volume volume-b982042d-ec8e-4491-a5cd-66dec2c27310 (b982042d-ec8e-4491-a5cd-66dec2c27310): created successfully
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be4de4-9d14-4dcb-b9cb-766d76ad61af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Flow 'volume_create_manager' (da72b750-dd7a-41ac-bc15-9161f6aef5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5d37fa00-f5e3-4d3f-ad43-46383af3a314 tempest-CreateVolumesFromImageTest-1365348142 None] Created volume successfully.
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f728479-e9bb-4fa1-b3a9-a7f54befae45]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (f49e3446-9539-42df-938a-4bfa4697a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:56 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7
Sep 20 17:01:56 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de65440-12a1-42b9-811d-7dc3af2f5557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de65440-12a1-42b9-811d-7dc3af2f5557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1994363010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e40a5b6-308d-4e26-a560-9b98a2d3890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2caa4698ec44cea797937076783998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:57Z,use_quota=True,user_id='bee61c0021d5488d8d6f25f20a9ef6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248d64c-5b7f-4dad-ac17-2e130eb6fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248d64c-5b7f-4dad-ac17-2e130eb6fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66046cf4-e77e-4b8f-a1d8-8c77e9216c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66046cf4-e77e-4b8f-a1d8-8c77e9216c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e40a5b6-308d-4e26-a560-9b98a2d3890e', 'volume_name': 'volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c44658-81f6-4a63-bb3b-9c5f5555e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c44658-81f6-4a63-bb3b-9c5f5555e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1148606f-7da8-4e73-8b19-900df44b3b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e', 'volume_size': 1}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1994363010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e40a5b6-308d-4e26-a560-9b98a2d3890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2caa4698ec44cea797937076783998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:01:57Z,use_quota=True,user_id='bee61c0021d5488d8d6f25f20a9ef6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Creating volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:01:56 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:56 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e 1073741824
Sep 20 17:01:56 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:56 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" returned: 0 in 0.373s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:56 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7
Sep 20 17:01:56 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-b982042d-ec8e-4491-a5cd-66dec2c27310-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-b982042d-ec8e-4491-a5cd-66dec2c27310-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:57 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-6ef3ca8c-522d-46cd-898b-5eabe8de74e7" released by "delete_volume" :: held 0.699s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e 1073741824" returned: 0 in 0.493s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-quobyte-b982042d-ec8e-4491-a5cd-66dec2c27310" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-b982042d-ec8e-4491-a5cd-66dec2c27310" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[03615a09-cbab-42e9-86b2-3a6c22584b0d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:57 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:01:57 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Created reservations ['daf805e9-6ceb-4caa-be56-8bca4cdc9b7e', '9f911d9c-ca17-4839-8b19-fb8a71d68087', '37b04dc6-f8a5-4eab-8f40-bf95a2ff1b67', '4a760114-aa0d-4b49-af8d-cb32ebd07507'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:57 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310
Sep 20 17:01:57 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:57 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.324s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1148606f-7da8-4e73-8b19-900df44b3b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af08db-72d2-43f8-81de-04a0657da2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:57 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Volume volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e (9e40a5b6-308d-4e26-a560-9b98a2d3890e): created successfully
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af08db-72d2-43f8-81de-04a0657da2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:57 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (f49e3446-9539-42df-938a-4bfa4697a92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-b65f35e8-26b9-41dd-a42e-e7b6ca954278-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d49ca22e-d8ce-4632-8a05-1999340cf492 tempest-VolumesDeleteCascade-2101641746 None] Created volume successfully.
Sep 20 17:01:57 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "cinder-b65f35e8-26b9-41dd-a42e-e7b6ca954278-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cc85023-c464-45ee-8e9a-3881f2724959 tempest-VolumesGetTest-1862417126 None] Lock "cinder-6ef3ca8c-522d-46cd-898b-5eabe8de74e7-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:57 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310
Sep 20 17:01:57 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-b65f35e8-26b9-41dd-a42e-e7b6ca954278" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-b65f35e8-26b9-41dd-a42e-e7b6ca954278" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd815e-0c96-44d5-9556-ddb7fb65daa8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:57 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:57 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:57 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b982042d-ec8e-4491-a5cd-66dec2c27310" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-b982042d-ec8e-4491-a5cd-66dec2c27310" released by "delete_volume" :: held 0.720s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Created reservations ['14466810-87f6-4f73-8e23-29891ea71e70', '41deb197-6249-4a95-b1eb-7278a3774c61', '1278a924-9892-4e6b-8d7a-19e832aa3350', 'f89f8ea6-9d11-45b1-8bef-dd8dbc2f4162'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:58 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.364s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278
Sep 20 17:01:58 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-71bf79d6-fb59-4008-9390-8ece6ba8f3a7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:58 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-71bf79d6-fb59-4008-9390-8ece6ba8f3a7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:58 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Deleted volume successfully.
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-quobyte-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-999950be-8e61-49bb-a047-3cd293d6ebb9 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-b982042d-ec8e-4491-a5cd-66dec2c27310-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:58 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b65f35e8-26b9-41dd-a42e-e7b6ca954278" returned: 0 in 0.287s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e498678e-3e96-4371-89c9-e63041f4df83]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-b65f35e8-26b9-41dd-a42e-e7b6ca954278" released by "delete_volume" :: held 0.729s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Created reservations ['7c8b2ffc-5eab-447a-8006-264bd9e13eb7', 'c8ff30cd-ee55-46b7-8ba6-745731422ba9', '41898a20-478b-4fcf-8b27-fe9ab8424686', '2e4ddc21-2b39-4408-9c7e-ed76fc0f0888'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:58 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7
Sep 20 17:01:58 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:58 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:58 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:01:58 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" returned: 0 in 0.457s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:58 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:58 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7
Sep 20 17:01:58 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-29692f00-4b9a-4768-8838-276676cb0368 tempest-VolumesGetTest-1862417126 None] Lock "cinder-b65f35e8-26b9-41dd-a42e-e7b6ca954278-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Creating offline snapshot 4300cd7d-b489-431f-964b-ba6924003b63 of volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c03c92-943c-415c-b1c5-612d780cb88f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:59 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:01:59 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:59 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-71bf79d6-fb59-4008-9390-8ece6ba8f3a7" released by "delete_volume" :: held 0.815s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Created reservations ['168cad19-94f9-451f-9359-635fed66b75a', '9662f094-b1b9-4f51-856f-4c4e356aeb81', 'c849e32c-83f2-4462-a09b-d543e4457443', 'b78e5b1d-484d-42b4-887c-46429b8db6c9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:59 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:01:59 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:59 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.427s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-58c167f9-9e5b-441f-b9cb-ef24b91f414f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:59 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 1G
Sep 20 17:01:59 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-58c167f9-9e5b-441f-b9cb-ef24b91f414f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-quobyte-58c167f9-9e5b-441f-b9cb-ef24b91f414f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-58c167f9-9e5b-441f-b9cb-ef24b91f414f" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ce05f-5ed0-428d-88f2-727b15be34b2]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:01:59 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.340s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:01:59 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Deleted volume successfully.
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee376039-238c-4d0e-b884-95617c102854 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-71bf79d6-fb59-4008-9390-8ece6ba8f3a7-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:01:59 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f
Sep 20 17:01:59 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (eb43a547-50f1-4dec-954f-9c93d97d98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f56a76-a0e1-42dd-ae69-edca8a42d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f56a76-a0e1-42dd-ae69-edca8a42d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1780028633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e0d4b-c228-4c13-9059-2f897250bb82,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:00Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1732cfd-ba78-42ca-b43b-3a4151f7933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1732cfd-ba78-42ca-b43b-3a4151f7933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c973c2-82dd-4076-aec5-d5793976f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:01:59 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:02:00 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 1G" returned: 0 in 0.611s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:00 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:00 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f
Sep 20 17:02:00 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c973c2-82dd-4076-aec5-d5793976f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b98e0d4b-c228-4c13-9059-2f897250bb82', 'volume_name': 'volume-b98e0d4b-c228-4c13-9059-2f897250bb82', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb90260>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507cc6e8-8b2c-4061-919f-bedc515e9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507cc6e8-8b2c-4061-919f-bedc515e9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f3aa21-b064-4a19-ba7d-f282f9c3ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:00 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Volume b98e0d4b-c228-4c13-9059-2f897250bb82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b98e0d4b-c228-4c13-9059-2f897250bb82', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb90260>}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Trying to clone b98e0d4b-c228-4c13-9059-2f897250bb82 from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:02:00 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:00 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:00 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 is being set with open permissions: ugo+rw
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-58c167f9-9e5b-441f-b9cb-ef24b91f414f" returned: 0 in 0.313s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:00 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:00 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-58c167f9-9e5b-441f-b9cb-ef24b91f414f" released by "delete_volume" :: held 0.815s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Created reservations ['3d274126-8f9d-490f-9d63-5fe1086c8db6', '54a2cb76-6a13-41b8-8ae6-a14adb1b92cb', '529d4ede-058f-4357-a4e7-d0e3da21926b', '9c0d960e-5168-4812-95f3-872cf6c9d268'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:02:00 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Image download 20.69 MB at 20.69 MB/s
Sep 20 17:02:00 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c51ac-ce76-4c1f-9cbd-6410438bbeeb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:00 devstack sudo[100790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info
Sep 20 17:02:00 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:00 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:00 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:00 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD
Sep 20 17:02:00 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:01 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info" returned: 0 in 0.285s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:01 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info is being set with open permissions: ugo+rw
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:01 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Deleted volume successfully.
Sep 20 17:02:01 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info
Sep 20 17:02:01 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-eaf33c20-da38-4450-bc6d-7c32b2eeaa8a tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-58c167f9-9e5b-441f-b9cb-ef24b91f414f-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:01 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 is fetched for user ddaa2c40d87343fcab58d51ea25ceec9. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ee1a8-b35a-4ed6-9451-f936b914157a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:01 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD
Sep 20 17:02:01 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:01 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.info" returned: 0 in 0.253s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b6c5a604-7d7c-49bf-9171-d456a2f87bef tempest-VolumesDeleteCascade-2101641746 None] Create snapshot completed successfully
Sep 20 17:02:01 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1780028633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e0d4b-c228-4c13-9059-2f897250bb82,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:00Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Creating volume b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:01 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:01 devstack sudo[100808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1073741824
Sep 20 17:02:01 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-60547b01-734f-4518-81c5-07a2f9dd9ba1-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-60547b01-734f-4518-81c5-07a2f9dd9ba1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-quobyte-60547b01-734f-4518-81c5-07a2f9dd9ba1" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-60547b01-734f-4518-81c5-07a2f9dd9ba1" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a19a31c-a6cc-4c1f-84af-d5e33af82d2d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:01 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1073741824" returned: 0 in 0.479s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack sudo[100813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1
Sep 20 17:02:02 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:02 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:02 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1" returned: 0 in 0.425s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Creating offline snapshot e487cf66-c58d-4674-9b02-f596543f1227 of volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:02:02 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1
Sep 20 17:02:02 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Attempting download of 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume b98e0d4b-c228-4c13-9059-2f897250bb82. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb11ad-711c-4be7-9849-14a6a43706c8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801c6d0-4391-4e10-b89b-b2ad1d04d894]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:02 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28
Sep 20 17:02:02 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-60547b01-734f-4518-81c5-07a2f9dd9ba1" returned: 0 in 0.259s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-60547b01-734f-4518-81c5-07a2f9dd9ba1" released by "delete_volume" :: held 0.727s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Created reservations ['d160491c-8414-44a2-960a-ff13b43933e8', '15a16104-c8bc-49fb-94bc-9f61dee5769b', 'd335c77a-4ee8-41e7-8d2d-192cdbbbc4ac', 'd95510c0-6a8c-4d0a-9dab-782228be4e88'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:02 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28" returned: 0 in 0.355s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:02 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 1G
Sep 20 17:02:02 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28
Sep 20 17:02:02 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-c9316c50-e09d-4cbe-9250-a0e3c3fb9159-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-c9316c50-e09d-4cbe-9250-a0e3c3fb9159-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:03 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Deleted volume successfully.
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "cinder-quobyte-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fb6e479-5dd6-4482-962f-69f2a82e91df tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-60547b01-734f-4518-81c5-07a2f9dd9ba1-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" acquired by "delete_volume" :: waited 0.036s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00628c2-ab99-43eb-a783-472e8fa33ce2]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28" returned: 1 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_vfz27h28' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44dcaf8-10e4-4db9-823a-05b6e98ba30a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159
Sep 20 17:02:03 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD
Sep 20 17:02:03 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 1G" returned: 0 in 0.552s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:03 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:02:03 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" returned: 0 in 0.415s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:03 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159
Sep 20 17:02:03 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.306s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 is being set with open permissions: ugo+rw
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:03 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:03 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:03 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" returned: 0 in 0.249s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-quobyte-c9316c50-e09d-4cbe-9250-a0e3c3fb9159" released by "delete_volume" :: held 0.709s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Created reservations ['86df7b13-fd27-4505-9970-a65bdb1ba494', '19c5afe0-65dd-4d75-999f-169eb9252d7f', 'b2130ffc-d830-4da9-a61a-98ecd813ea9a', 'f48b2a74-1d43-4b2a-b6b6-d3a1fab90ee9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:03 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.654s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ab17e243-3e1a-42c6-b3e7-b970b76d2f18 tempest-VolumesDeleteCascade-2101641746 None] Create snapshot completed successfully
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:04 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:04 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:04 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.321s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Deleted volume successfully.
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a38f226-bd0d-4ea0-bac3-bf04c20ee1d1 tempest-CreateVolumesFromImageTest-1365348142 None] Lock "cinder-c9316c50-e09d-4cbe-9250-a0e3c3fb9159-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-9e40a5b6-308d-4e26-a560-9b98a2d3890e-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-9e40a5b6-308d-4e26-a560-9b98a2d3890e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Performing cascade delete. {{(pid=85945) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-4300cd7d-b489-431f-964b-ba6924003b63-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-4300cd7d-b489-431f-964b-ba6924003b63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-4300cd7d-b489-431f-964b-ba6924003b63" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-4300cd7d-b489-431f-964b-ba6924003b63" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Deleting offline snapshot 4300cd7d-b489-431f-964b-ba6924003b63 of volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] snapshot_file for this snap is: volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132cd86-5a21-4305-a347-c7d03f709302]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:04 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:04 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:05 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.421s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd39021c-102b-41d9-a077-07e571c9cf7a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:05 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:02:05 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:05 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 0 in 1.821s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_9x04ibl3devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:02:05 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Converted 112.00 MB image at 61.45 MB/s
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:05 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1G
Sep 20 17:02:05 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:05 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.456s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d5a1b-e104-4ecd-9bab-bc40abae4023]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:05 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 1G" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0750fe9-864b-40fb-a0f6-140176bcdf63]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:05 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:05 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:05 devstack sudo[100896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:05 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:06 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f0db8-9872-4a9e-b155-e55de54a6f1c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:06 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:06 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:06 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:06 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:06 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:06 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2492cd63-7a58-4049-a87c-5f07fb348f3a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:06 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 1 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Downloaded image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume b98e0d4b-c228-4c13-9059-2f897250bb82 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 for user ddaa2c40d87343fcab58d51ea25ceec9 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Marking volume b98e0d4b-c228-4c13-9059-2f897250bb82 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Copying metadata from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 to b98e0d4b-c228-4c13-9059-2f897250bb82. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Creating volume glance metadata for volume b98e0d4b-c228-4c13-9059-2f897250bb82 backed by image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:02:06 devstack sudo[100913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:02:06 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f3aa21-b064-4a19-ba7d-f282f9c3ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e0d4b-c228-4c13-9059-2f897250bb82', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb90260>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71939cce-fd6b-465d-a208-1e0c70a3714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:06 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Volume volume-b98e0d4b-c228-4c13-9059-2f897250bb82 (b98e0d4b-c228-4c13-9059-2f897250bb82): created successfully
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71939cce-fd6b-465d-a208-1e0c70a3714a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (eb43a547-50f1-4dec-954f-9c93d97d98eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-49f26443-05bb-4cac-8cb6-ea6d107082fd tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:02:06 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:06 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:06 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:07 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:07 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63
Sep 20 17:02:07 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:07 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.4300cd7d-b489-431f-964b-ba6924003b63" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 -F qcow2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:07 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 -F qcow2
Sep 20 17:02:07 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:07 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 -F qcow2" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-4300cd7d-b489-431f-964b-ba6924003b63" released by "_delete_snapshot" :: held 3.339s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" released by "delete_snapshot" :: held 3.371s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['1db6c9fd-406a-446d-9d1f-8f01d3ddd848', '0dab05ce-0189-43d7-b000-0a3b1a4d5395', '7016aeee-d75c-4759-9e71-7285bd843661', '6c720d0b-2a8e-4acf-a55a-76f69ef8d92d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Delete snapshot completed successfully.
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-4300cd7d-b489-431f-964b-ba6924003b63-delete_snapshot" released by "delete_snapshot" :: held 3.581s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-e487cf66-c58d-4674-9b02-f596543f1227-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-e487cf66-c58d-4674-9b02-f596543f1227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (04881e02-c259-4dd8-ad79-960903a8243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d710c7b-bc10-4892-8b6f-2850b08919a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-e487cf66-c58d-4674-9b02-f596543f1227" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d710c7b-bc10-4892-8b6f-2850b08919a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980500646',display_name='tempest-VolumesGetTest-Volume-884641451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16033f8b-f490-48bf-a5dc-9662852645b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:08Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502578ef-08af-4943-8200-d44a64b08768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502578ef-08af-4943-8200-d44a64b08768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7f7671-4856-472c-ad76-129096bb86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7f7671-4856-472c-ad76-129096bb86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16033f8b-f490-48bf-a5dc-9662852645b6', 'volume_name': 'volume-16033f8b-f490-48bf-a5dc-9662852645b6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f00a7-7322-46c8-9263-9741c818bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f00a7-7322-46c8-9263-9741c818bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896443a-325b-4d53-9ee4-809e3cd6a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Volume 16033f8b-f490-48bf-a5dc-9662852645b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16033f8b-f490-48bf-a5dc-9662852645b6', 'volume_size': 1}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980500646',display_name='tempest-VolumesGetTest-Volume-884641451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16033f8b-f490-48bf-a5dc-9662852645b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053f6c5d86649fe844c65efec7a4f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:08Z,use_quota=True,user_id='ddaa2c40d87343fcab58d51ea25ceec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Creating volume 16033f8b-f490-48bf-a5dc-9662852645b6 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:08 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-e487cf66-c58d-4674-9b02-f596543f1227" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Deleting offline snapshot e487cf66-c58d-4674-9b02-f596543f1227 of volume 9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:02:08 devstack sudo[100933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 1073741824
Sep 20 17:02:08 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] snapshot_file for this snap is: volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f3ac3-b0ce-4975-88a4-20fd8dfe4c63]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:08 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:08 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:08 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:08 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 1073741824" returned: 0 in 0.491s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5481d-27e3-49a8-9de4-96aab52e1716]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:08 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6
Sep 20 17:02:08 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:08 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:02:09 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:09 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6" returned: 0 in 0.270s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896443a-325b-4d53-9ee4-809e3cd6a779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16033f8b-f490-48bf-a5dc-9662852645b6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2280281-ce2e-422d-9c2e-2363991dc4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Volume volume-16033f8b-f490-48bf-a5dc-9662852645b6 (16033f8b-f490-48bf-a5dc-9662852645b6): created successfully
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2280281-ce2e-422d-9c2e-2363991dc4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Flow 'volume_create_manager' (04881e02-c259-4dd8-ad79-960903a8243b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5bd167f7-fbdc-40dd-b294-9a50c136f163 tempest-VolumesGetTest-1862417126 None] Created volume successfully.
Sep 20 17:02:09 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.415s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:09 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:09 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:09 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.364s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:09 devstack sudo[100957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227
Sep 20 17:02:09 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:09 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e.e487cf66-c58d-4674-9b02-f596543f1227" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-e487cf66-c58d-4674-9b02-f596543f1227" released by "_delete_snapshot" :: held 1.647s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:09 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" released by "delete_snapshot" :: held 1.739s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['476eed99-53fc-41b1-b6ed-108d2d8a294a', '6c062664-8bfe-4a73-b813-ab1d55a1e5dc', 'ccbf2477-726a-4028-9606-5584b4e79af7', 'a301db8b-9f25-4500-87a9-b9d6d0bce4b9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Delete snapshot completed successfully.
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-e487cf66-c58d-4674-9b02-f596543f1227-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Snapshots deleted, issuing volume delete {{(pid=85945) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" acquired by "delete_volume" :: waited 0.034s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec44a00-5b1c-40f8-bc19-540595e1e064]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:10 devstack sudo[100961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:02:10 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-16033f8b-f490-48bf-a5dc-9662852645b6-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "cinder-16033f8b-f490-48bf-a5dc-9662852645b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-16033f8b-f490-48bf-a5dc-9662852645b6" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-16033f8b-f490-48bf-a5dc-9662852645b6" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870210d-dfa4-4071-bdc6-bb296805fa80]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:10 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6
Sep 20 17:02:10 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:10 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:10 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e
Sep 20 17:02:10 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:10 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6" returned: 0 in 0.385s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:10 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6
Sep 20 17:02:10 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:10 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9e40a5b6-308d-4e26-a560-9b98a2d3890e" returned: 0 in 0.281s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-9e40a5b6-308d-4e26-a560-9b98a2d3890e" released by "delete_volume" :: held 0.809s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['78b676a7-6dd1-40e8-9920-22a00c77c640', 'c905b7ed-164d-4cb4-a132-7a2ac22ff4d9', 'be90598d-c6ab-445c-92b6-9a13ec291641', '2d25942e-b0ec-4044-b660-05642326ae52'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:11 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:11 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:11 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-16033f8b-f490-48bf-a5dc-9662852645b6" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-16033f8b-f490-48bf-a5dc-9662852645b6" released by "delete_volume" :: held 0.745s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Created reservations ['0c807759-5f59-4a68-8938-0ee1b73a65cd', '8639bcad-33a0-4c6a-887e-cc48a03ea28d', '942c1860-7703-49b4-b5d1-56c472ba49b8', '7c641b0d-bd2f-468e-90ee-b6d7bc7f2777'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:11 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:11 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:11 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Deleted volume successfully.
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a0ef5030-1511-464e-9fb6-bc6b3c947fe6 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-9e40a5b6-308d-4e26-a560-9b98a2d3890e-delete_volume" released by "delete_volume" :: held 6.971s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:11 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-b98e0d4b-c228-4c13-9059-2f897250bb82-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24103052-48f6-44d4-8d62-7b1973e2ff45 tempest-VolumesGetTest-1862417126 None] Lock "cinder-16033f8b-f490-48bf-a5dc-9662852645b6-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "cinder-b98e0d4b-c228-4c13-9059-2f897250bb82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Acquiring lock "cinder-quobyte-b98e0d4b-c228-4c13-9059-2f897250bb82" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-b98e0d4b-c228-4c13-9059-2f897250bb82" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e67049-35be-44ed-9a7f-71d2fcc999f2]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:11 devstack sudo[100984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:11 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:12 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:12 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:12 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:12 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 1 in 0.422s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:12 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82
Sep 20 17:02:12 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:12 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b98e0d4b-c228-4c13-9059-2f897250bb82" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "cinder-quobyte-b98e0d4b-c228-4c13-9059-2f897250bb82" released by "delete_volume" :: held 1.265s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Created reservations ['bfe8de9b-ddb0-457d-bf33-576695132fe1', '44fa8298-0fd9-4c1c-b0d7-00291e8186da', '42bc7cc6-7656-433e-ae4d-6640c648a10e', '2a8f515d-814a-4ab1-9ee0-8f4051175036'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (7e760584-b02e-4bef-bf83-ba227fa567cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d62b356-2cfc-4d06-b236-6b2d9102b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d62b356-2cfc-4d06-b236-6b2d9102b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1402287131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fc206f-9e65-4fb2-96de-619b2ade4758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2caa4698ec44cea797937076783998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:13Z,use_quota=True,user_id='bee61c0021d5488d8d6f25f20a9ef6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5cf29a-b35f-4980-97e1-269c81bb3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5cf29a-b35f-4980-97e1-269c81bb3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d00354-0abb-4893-afe9-21f983167156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d00354-0abb-4893-afe9-21f983167156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fc206f-9e65-4fb2-96de-619b2ade4758', 'volume_name': 'volume-84fc206f-9e65-4fb2-96de-619b2ade4758', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7111acc2-13e4-4c4c-968b-76b6bb8628c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7111acc2-13e4-4c4c-968b-76b6bb8628c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7458ae-8d3d-49c4-ad4f-ad667e2b7d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Volume 84fc206f-9e65-4fb2-96de-619b2ade4758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fc206f-9e65-4fb2-96de-619b2ade4758', 'volume_size': 1}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1402287131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fc206f-9e65-4fb2-96de-619b2ade4758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2caa4698ec44cea797937076783998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:13Z,use_quota=True,user_id='bee61c0021d5488d8d6f25f20a9ef6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Creating volume 84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:13 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:13 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 1073741824
Sep 20 17:02:13 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:13 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:13 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:13 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.280s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Deleted volume successfully.
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3e9aadfe-e328-4867-997a-7be7bf4acdd2 tempest-VolumesGetTest-1862417126 None] Lock "cinder-b98e0d4b-c228-4c13-9059-2f897250bb82-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:13 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 1073741824" returned: 0 in 0.502s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:13 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:13 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:14 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7458ae-8d3d-49c4-ad4f-ad667e2b7d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fc206f-9e65-4fb2-96de-619b2ade4758', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee78a9c-1bb8-4be7-b183-fb1b6f1fc042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Volume volume-84fc206f-9e65-4fb2-96de-619b2ade4758 (84fc206f-9e65-4fb2-96de-619b2ade4758): created successfully
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee78a9c-1bb8-4be7-b183-fb1b6f1fc042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (7e760584-b02e-4bef-bf83-ba227fa567cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-340dd31e-4569-4c77-8173-5257f9c00be5 tempest-VolumesDeleteCascade-2101641746 None] Created volume successfully.
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Creating offline snapshot 0efc2499-0c1d-4ed1-b318-4b6173f08aff of volume 84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[97922e6d-adc6-40d1-85e8-d2cf6c3e94f3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:15 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:15 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:15 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:15 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff 1G
Sep 20 17:02:15 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:16 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff 1G" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fc206f-9e65-4fb2-96de-619b2ade4758 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:16 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fc206f-9e65-4fb2-96de-619b2ade4758 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:16 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:16 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fc206f-9e65-4fb2-96de-619b2ade4758 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:16 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff is being set with open permissions: ugo+rw
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:16 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:16 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:16 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:16 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info
Sep 20 17:02:16 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:17 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:17 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info is being set with open permissions: ugo+rw
Sep 20 17:02:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:17 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info
Sep 20 17:02:17 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:17 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.info" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d26bc4b0-1143-4cf7-ad36-e5909325ab8b tempest-VolumesDeleteCascade-2101641746 None] Create snapshot completed successfully
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (218fb1f7-a55a-4293-82eb-dd7946275993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad00045f-d2b8-484d-ae80-7be55f7d0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad00045f-d2b8-484d-ae80-7be55f7d0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-179437122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8baba38-40c2-4af4-b246-92c7d199d4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2caa4698ec44cea797937076783998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0efc2499-0c1d-4ed1-b318-4b6173f08aff,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:19Z,use_quota=True,user_id='bee61c0021d5488d8d6f25f20a9ef6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1b37ea-10a5-45b1-8575-20898f6606f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1b37ea-10a5-45b1-8575-20898f6606f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d7821f-af28-46f0-8a4a-dd71aaa52c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d7821f-af28-46f0-8a4a-dd71aaa52c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8baba38-40c2-4af4-b246-92c7d199d4c3', 'volume_name': 'volume-d8baba38-40c2-4af4-b246-92c7d199d4c3', 'volume_size': 1, 'snapshot_id': '0efc2499-0c1d-4ed1-b318-4b6173f08aff'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd175fc-14d3-430a-97b4-fedaf5741aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd175fc-14d3-430a-97b4-fedaf5741aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1eef919-0500-4084-9707-c5d6bf52801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Volume d8baba38-40c2-4af4-b246-92c7d199d4c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8baba38-40c2-4af4-b246-92c7d199d4c3', 'volume_size': 1, 'snapshot_id': '0efc2499-0c1d-4ed1-b318-4b6173f08aff'}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff-d8baba38-40c2-4af4-b246-92c7d199d4c3" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff-d8baba38-40c2-4af4-b246-92c7d199d4c3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Creating volume d8baba38-40c2-4af4-b246-92c7d199d4c3 from snapshot 0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] snapshot: 0efc2499-0c1d-4ed1-b318-4b6173f08aff, volume: d8baba38-40c2-4af4-b246-92c7d199d4c3,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cccd7e-b80c-45df-9d8e-c2115245c3ed]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:19 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:19 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:19 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84fc206f-9e65-4fb2-96de-619b2ade4758(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d03831-c2c0-48bf-a08c-fcc6a5b17d78]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:19 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:19 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:20 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:20 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:02:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:20 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3
Sep 20 17:02:20 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:27 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3" returned: 0 in 7.143s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddabf0a-603b-4dc1-9cb8-43a49bd13939]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:27 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:27 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:27 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:02:27 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Converted 1024.00 MB image at 143.33 MB/s
Sep 20 17:02:27 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 is being set with open permissions: ugo+rw
Sep 20 17:02:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:27 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3
Sep 20 17:02:27 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:28 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" released by "_copy_volume_from_snapshot" :: held 8.896s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff-d8baba38-40c2-4af4-b246-92c7d199d4c3" released by "_create_volume_from_snapshot" :: held 8.931s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.948s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1eef919-0500-4084-9707-c5d6bf52801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8baba38-40c2-4af4-b246-92c7d199d4c3', 'volume_size': 1, 'snapshot_id': '0efc2499-0c1d-4ed1-b318-4b6173f08aff'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ea4fc6-5784-4a55-9519-832ecdddf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:28 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Volume volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 (d8baba38-40c2-4af4-b246-92c7d199d4c3): created successfully
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ea4fc6-5784-4a55-9519-832ecdddf33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Flow 'volume_create_manager' (218fb1f7-a55a-4293-82eb-dd7946275993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-82fa04fb-173c-4dae-9315-a8573961b628 tempest-VolumesDeleteCascade-2101641746 None] Created volume successfully.
Sep 20 17:02:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-84fc206f-9e65-4fb2-96de-619b2ade4758-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-84fc206f-9e65-4fb2-96de-619b2ade4758-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Performing cascade delete. {{(pid=85945) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-0efc2499-0c1d-4ed1-b318-4b6173f08aff-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-0efc2499-0c1d-4ed1-b318-4b6173f08aff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Deleting offline snapshot 0efc2499-0c1d-4ed1-b318-4b6173f08aff of volume 84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] snapshot_file for this snap is: volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f2b529-7392-4d62-8808-f11fa2d16cba]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:29 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:29 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:29 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.382s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84fc206f-9e65-4fb2-96de-619b2ade4758(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fc8c6-db8b-4700-94d3-02fbc2cd1b63]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:29 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:29 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:29 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:29 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:29 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:30 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:30 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff
Sep 20 17:02:30 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:30 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758.0efc2499-0c1d-4ed1-b318-4b6173f08aff" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-0efc2499-0c1d-4ed1-b318-4b6173f08aff" released by "_delete_snapshot" :: held 1.529s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" released by "delete_snapshot" :: held 1.551s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['100178ed-b2e6-40ac-9e66-6347237020d8', 'e6c1f7a8-b52b-4645-800a-db5e78355567', '677ed9c9-383b-4185-99e0-c5e98bb81b33', 'dec381d6-65f4-4a97-abc0-3163e9699084'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Delete snapshot completed successfully.
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-0efc2499-0c1d-4ed1-b318-4b6173f08aff-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Snapshots deleted, issuing volume delete {{(pid=85945) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0790b141-cd77-4c87-a13c-c94367273a06]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:30 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:30 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:31 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.422s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:31 devstack sudo[101095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758
Sep 20 17:02:31 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:31 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-84fc206f-9e65-4fb2-96de-619b2ade4758" returned: 0 in 0.280s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-84fc206f-9e65-4fb2-96de-619b2ade4758" released by "delete_volume" :: held 0.772s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['a6deddf2-f4f2-4fa1-a3ae-fc3cde0e39a5', '42dc0c69-301c-403c-a455-14d4a11b55a1', '0513531f-9c7b-4c69-b248-ddee2a790a0f', 'ed12f0f5-01a3-430b-9bbf-f01955150bcb'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:31 devstack sudo[101098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:31 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:31 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Deleted volume successfully.
Sep 20 17:02:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-318447a1-13af-49eb-99b8-c46880bf0c75 tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-84fc206f-9e65-4fb2-96de-619b2ade4758-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-d8baba38-40c2-4af4-b246-92c7d199d4c3-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-d8baba38-40c2-4af4-b246-92c7d199d4c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[523d9a8f-85a1-4670-92c3-5ec56b189358]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:32 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3
Sep 20 17:02:32 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:32 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:33 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3
Sep 20 17:02:33 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:33 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d8baba38-40c2-4af4-b246-92c7d199d4c3" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-quobyte-d8baba38-40c2-4af4-b246-92c7d199d4c3" released by "delete_volume" :: held 0.705s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Created reservations ['0741f0d2-d8b5-4201-8575-081f5e24af8c', 'f5ca4221-d2d6-4972-9825-1e021420c3f1', '736ab843-728b-4e79-b0f5-3c658dcc5547', '0b868997-9d4c-429e-8bbe-2f5b33bbbd7d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:33 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:33 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:33 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Deleted volume successfully.
Sep 20 17:02:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1dba218a-6065-4459-b3cb-aef1d031f37a tempest-VolumesDeleteCascade-2101641746 None] Lock "cinder-d8baba38-40c2-4af4-b246-92c7d199d4c3-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Flow 'volume_create_manager' (29e543f2-55b7-4323-89c1-ad5c5deb25ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507714b3-ccdb-40f0-8394-8a6a863ff276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507714b3-ccdb-40f0-8394-8a6a863ff276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-941823214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396065f2-39ed-406d-904f-4a05bb84296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba749263bfe41c492d17bf77dc60990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:39Z,use_quota=True,user_id='a1fdba023b37428aa2508f9979c49468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee89606-79d6-47b7-a109-312562747850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee89606-79d6-47b7-a109-312562747850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707490e4-d986-4e20-8b2b-c3fa9d8a2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707490e4-d986-4e20-8b2b-c3fa9d8a2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396065f2-39ed-406d-904f-4a05bb84296b', 'volume_name': 'volume-396065f2-39ed-406d-904f-4a05bb84296b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042ed0a-2fcb-4ecc-ab59-3bcb51371b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042ed0a-2fcb-4ecc-ab59-3bcb51371b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a636d0be-1a2e-41b2-9a46-8df0bdd17e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:39 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Volume 396065f2-39ed-406d-904f-4a05bb84296b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396065f2-39ed-406d-904f-4a05bb84296b', 'volume_size': 1}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-941823214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396065f2-39ed-406d-904f-4a05bb84296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba749263bfe41c492d17bf77dc60990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:39Z,use_quota=True,user_id='a1fdba023b37428aa2508f9979c49468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Creating volume 396065f2-39ed-406d-904f-4a05bb84296b {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:39 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:39 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b 1073741824
Sep 20 17:02:39 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:39 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b 1073741824" returned: 0 in 0.539s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:40 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b
Sep 20 17:02:40 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:40 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a636d0be-1a2e-41b2-9a46-8df0bdd17e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396065f2-39ed-406d-904f-4a05bb84296b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c8133c-ce1d-4aa5-8d50-dc0e5ed58808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:40 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Volume volume-396065f2-39ed-406d-904f-4a05bb84296b (396065f2-39ed-406d-904f-4a05bb84296b): created successfully
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c8133c-ce1d-4aa5-8d50-dc0e5ed58808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Flow 'volume_create_manager' (29e543f2-55b7-4323-89c1-ad5c5deb25ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-78bf7f9a-30ac-414c-a4d1-c60aabb0d9f8 tempest-VolumesTransfersV355Test-70228653 None] Created volume successfully.
Sep 20 17:02:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0c8ad1e7-c364-4e2e-a162-4c6d148b9672 tempest-VolumesTransfersV355Test-562161123 None] Transfer volume completed successfully.
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "cinder-396065f2-39ed-406d-904f-4a05bb84296b-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-396065f2-39ed-406d-904f-4a05bb84296b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "cinder-quobyte-396065f2-39ed-406d-904f-4a05bb84296b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-quobyte-396065f2-39ed-406d-904f-4a05bb84296b" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d266284-3408-4d4a-8e85-3fef9d2b0929]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:42 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b
Sep 20 17:02:42 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:43 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:43 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b
Sep 20 17:02:43 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:43 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396065f2-39ed-406d-904f-4a05bb84296b" returned: 0 in 0.263s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-quobyte-396065f2-39ed-406d-904f-4a05bb84296b" released by "delete_volume" :: held 0.724s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Created reservations ['e427c228-063c-4c78-97fc-0ca8f796dd27', '24354fc8-22ac-44a6-953c-47b522e48195', '49fc1738-2a2d-4037-94c1-389e92c91810', '8e930754-0719-4498-bc7b-8170abac2538'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:43 devstack sudo[101133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:43 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (5bf4f7e5-d378-4569-ae04-87d028dce1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87770d86-b489-419d-bc5e-cd4d1b0401a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87770d86-b489-419d-bc5e-cd4d1b0401a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2040199806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cbcbdd-4028-4c1c-91de-66eecfc3c707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b09b84-30f3-4aed-bd92-0e37fa03903e),volume_type_id=f5b09b84-30f3-4aed-bd92-0e37fa03903e)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e952fb4-c032-4d98-81c0-80d9edfabae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e952fb4-c032-4d98-81c0-80d9edfabae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c61eca7-00bd-4bde-a99a-71876d477bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c61eca7-00bd-4bde-a99a-71876d477bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cbcbdd-4028-4c1c-91de-66eecfc3c707', 'volume_name': 'volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2a762-aefc-4073-bd71-51e6e502b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2a762-aefc-4073-bd71-51e6e502b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba769bd8-ac67-4f6c-94b5-19a925fecd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume 33cbcbdd-4028-4c1c-91de-66eecfc3c707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707', 'volume_size': 1}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2040199806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cbcbdd-4028-4c1c-91de-66eecfc3c707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b09b84-30f3-4aed-bd92-0e37fa03903e),volume_type_id=f5b09b84-30f3-4aed-bd92-0e37fa03903e)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Creating volume 33cbcbdd-4028-4c1c-91de-66eecfc3c707 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:43 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:43 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 1073741824
Sep 20 17:02:43 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:43 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.383s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Deleted volume successfully.
Sep 20 17:02:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9345d092-cfcf-4bd4-af75-869ba70509aa tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-396065f2-39ed-406d-904f-4a05bb84296b-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (250e369b-d5ea-4b7f-b990-ac4c5f5f2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64e39b2-c577-4387-af06-efb0d2d8950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64e39b2-c577-4387-af06-efb0d2d8950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1703541982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32ac7e1-25a1-4956-8958-c39b1040c1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e4cd7b-8093-494d-938d-9501c09830aa),volume_type_id=83e4cd7b-8093-494d-938d-9501c09830aa)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f159ee8-4d45-4b8f-bf44-c042e38b8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f159ee8-4d45-4b8f-bf44-c042e38b8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115a47d-eb3b-4ab6-9255-ea539df3ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115a47d-eb3b-4ab6-9255-ea539df3ce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32ac7e1-25a1-4956-8958-c39b1040c1af', 'volume_name': 'volume-f32ac7e1-25a1-4956-8958-c39b1040c1af', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7ada0a-30ed-4789-88a9-8ed4d840beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7ada0a-30ed-4789-88a9-8ed4d840beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831c4e49-0b49-4bf8-893b-1a249155b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume f32ac7e1-25a1-4956-8958-c39b1040c1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32ac7e1-25a1-4956-8958-c39b1040c1af', 'volume_size': 1}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:44 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 1073741824" returned: 0 in 0.633s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:44 devstack sudo[101141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707
Sep 20 17:02:44 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Flow 'volume_create_manager' (b0eddd58-6c25-40e6-963b-ad5b786e197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc64d7-b440-4a22-955c-f02c3275fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc64d7-b440-4a22-955c-f02c3275fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-247781837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08ebf8e-8603-40f9-8635-7926af180387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba749263bfe41c492d17bf77dc60990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='a1fdba023b37428aa2508f9979c49468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916b9e04-bcf6-49bb-9024-fa94bfb567eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916b9e04-bcf6-49bb-9024-fa94bfb567eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f54632-dd45-466f-be2a-b8f48a01f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f54632-dd45-466f-be2a-b8f48a01f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08ebf8e-8603-40f9-8635-7926af180387', 'volume_name': 'volume-d08ebf8e-8603-40f9-8635-7926af180387', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ee1ee3-2066-41e1-8149-7e50179596cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ee1ee3-2066-41e1-8149-7e50179596cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dd7f86-9d18-42a4-bff4-a2755b1068fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Volume d08ebf8e-8603-40f9-8635-7926af180387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08ebf8e-8603-40f9-8635-7926af180387', 'volume_size': 1}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:44 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1703541982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32ac7e1-25a1-4956-8958-c39b1040c1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e4cd7b-8093-494d-938d-9501c09830aa),volume_type_id=83e4cd7b-8093-494d-938d-9501c09830aa)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Creating volume f32ac7e1-25a1-4956-8958-c39b1040c1af {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:44 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba769bd8-ac67-4f6c-94b5-19a925fecd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd8356-53f4-4abc-be20-37f07ff80e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af 1073741824
Sep 20 17:02:44 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:44 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 (33cbcbdd-4028-4c1c-91de-66eecfc3c707): created successfully
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd8356-53f4-4abc-be20-37f07ff80e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (5bf4f7e5-d378-4569-ae04-87d028dce1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-286f8f1f-f60e-498e-a761-731926b5612c tempest-TestInstancesWithCinderVolumes-1014944988 None] Created volume successfully.
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (e6320d46-93e3-414f-a6bc-42da66421baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c960bdd-19a9-4244-baa0-82ab7978191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c960bdd-19a9-4244-baa0-82ab7978191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1493952909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d427bc-6dff-4d44-ad11-e32f4408da65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:45Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fc160b-d4bd-4b2f-9310-25ace4ef39e5),volume_type_id=b7fc160b-d4bd-4b2f-9310-25ace4ef39e5)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170f7e72-ae90-4ee8-ae15-9c945eec0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170f7e72-ae90-4ee8-ae15-9c945eec0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab401189-a0fa-4de5-87ee-fa0290c37d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:44 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab401189-a0fa-4de5-87ee-fa0290c37d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69d427bc-6dff-4d44-ad11-e32f4408da65', 'volume_name': 'volume-69d427bc-6dff-4d44-ad11-e32f4408da65', 'volume_size': 1, 'image_id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1520792044', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75287f104d444a1cbdf0f0dd41f55447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'created_at': datetime.datetime(2026, 9, 20, 15, 2, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 2, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7074152-6ab5-4285-bfc3-7af082387683/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019580c0e0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c05b99-10df-48fc-907c-4d35b5b50fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c05b99-10df-48fc-907c-4d35b5b50fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17186181-f374-4f95-9bd9-47605081ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume 69d427bc-6dff-4d44-ad11-e32f4408da65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69d427bc-6dff-4d44-ad11-e32f4408da65', 'volume_size': 1, 'image_id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1520792044', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75287f104d444a1cbdf0f0dd41f55447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'created_at': datetime.datetime(2026, 9, 20, 15, 2, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 2, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7074152-6ab5-4285-bfc3-7af082387683/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019580c0e0>}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Trying to clone 69d427bc-6dff-4d44-ad11-e32f4408da65 from image f7074152-6ab5-4285-bfc3-7af082387683 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:02:45 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af 1073741824" returned: 0 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:45 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af
Sep 20 17:02:45 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:45 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-247781837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08ebf8e-8603-40f9-8635-7926af180387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba749263bfe41c492d17bf77dc60990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:44Z,use_quota=True,user_id='a1fdba023b37428aa2508f9979c49468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Creating volume d08ebf8e-8603-40f9-8635-7926af180387 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:45 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831c4e49-0b49-4bf8-893b-1a249155b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32ac7e1-25a1-4956-8958-c39b1040c1af', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:45 devstack sudo[101153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 1073741824
Sep 20 17:02:45 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa2550e-7cc0-40cf-8ca5-cac9a238d2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:45 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume volume-f32ac7e1-25a1-4956-8958-c39b1040c1af (f32ac7e1-25a1-4956-8958-c39b1040c1af): created successfully
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa2550e-7cc0-40cf-8ca5-cac9a238d2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:45 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (250e369b-d5ea-4b7f-b990-ac4c5f5f2de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c1894003-c579-4fb9-86d0-34c735a3247b tempest-TestInstancesWithCinderVolumes-1014944988 None] Created volume successfully.
Sep 20 17:02:46 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 1073741824" returned: 0 in 0.499s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:46 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387
Sep 20 17:02:46 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:46 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dd7f86-9d18-42a4-bff4-a2755b1068fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08ebf8e-8603-40f9-8635-7926af180387', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134896c-291f-4642-aefd-f74bcfbd962d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:46 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Volume volume-d08ebf8e-8603-40f9-8635-7926af180387 (d08ebf8e-8603-40f9-8635-7926af180387): created successfully
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134896c-291f-4642-aefd-f74bcfbd962d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Flow 'volume_create_manager' (b0eddd58-6c25-40e6-963b-ad5b786e197e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1d181a55-99ee-4d6d-bdc0-8cadae474def tempest-VolumesTransfersV355Test-70228653 None] Created volume successfully.
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "cinder-d08ebf8e-8603-40f9-8635-7926af180387-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-d08ebf8e-8603-40f9-8635-7926af180387-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "cinder-quobyte-d08ebf8e-8603-40f9-8635-7926af180387" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-quobyte-d08ebf8e-8603-40f9-8635-7926af180387" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37fb2b4-e52e-4e4b-8b44-4e37ec440d56]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:47 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387
Sep 20 17:02:47 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:47 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387" returned: 0 in 0.398s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:47 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387
Sep 20 17:02:47 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:47 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-d08ebf8e-8603-40f9-8635-7926af180387" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-quobyte-d08ebf8e-8603-40f9-8635-7926af180387" released by "delete_volume" :: held 0.720s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=204,cinder:SELECT=132,cinder:INSERT=58,cinder:DELETE=15 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=161,cinder:SELECT=144,cinder:DELETE=18,cinder:INSERT=40 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Created reservations ['c3e4d546-1c05-48ac-ae56-140b50909f7e', '06d1d7f7-eaba-498c-9d3d-dbd01086ad80', 'e7c6f6e0-a19f-4a84-a6d0-91dc6912a0f3', 'c54d6419-6dfb-45fa-9e3a-7d1031115732'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:47 devstack sudo[101170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:47 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:48 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.358s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:48 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Deleted volume successfully.
Sep 20 17:02:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1797633b-7a79-4a22-844b-85d7ca8485ff tempest-VolumesTransfersV355Test-966778537 None] Lock "cinder-d08ebf8e-8603-40f9-8635-7926af180387-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:02:48 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD, size 20.69 MB, duration 3.78 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:02:48 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Image download 20.69 MB at 5.47 MB/s
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a733e63-869a-4758-a37b-8346d0b8c1e5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:49 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD
Sep 20 17:02:49 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:49 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Temporary image f7074152-6ab5-4285-bfc3-7af082387683 is fetched for user b841cdc03a8341ddb85f4dda49dbfced. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ff3a03-3a25-424b-9a42-68634f712481]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:49 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD
Sep 20 17:02:49 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:49 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1493952909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d427bc-6dff-4d44-ad11-e32f4408da65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75287f104d444a1cbdf0f0dd41f55447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:45Z,use_quota=True,user_id='b841cdc03a8341ddb85f4dda49dbfced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fc160b-d4bd-4b2f-9310-25ace4ef39e5),volume_type_id=b7fc160b-d4bd-4b2f-9310-25ace4ef39e5)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Creating volume 69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:49 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:49 devstack sudo[101184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1073741824
Sep 20 17:02:49 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:50 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1073741824" returned: 0 in 0.487s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:50 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:50 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:50 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Attempting download of f7074152-6ab5-4285-bfc3-7af082387683 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}])) to volume 69d427bc-6dff-4d44-ad11-e32f4408da65. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad41930-d01c-48ac-abe9-52052982288c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:50 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw
Sep 20 17:02:50 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:51 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:51 devstack sudo[101198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw
Sep 20 17:02:51 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:51 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw" returned: 1 in 0.376s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7074152-6ab5-4285-bfc3-7af082387683_ybsec1cw' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a4cd57-18d0-4cc4-b641-361c40ab5406]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:51 devstack sudo[101202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD
Sep 20 17:02:51 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:51 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] f7074152-6ab5-4285-bfc3-7af082387683 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:02:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:51 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:51 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:53 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 1.718s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7074152-6ab5-4285-bfc3-7af082387683_4c2pwuj5devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:02:53 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Converted 112.00 MB image at 65.15 MB/s
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:53 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1G
Sep 20 17:02:53 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:53 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 1G" returned: 0 in 0.318s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[26399ef8-5e14-42b3-af64-92c5a774073d]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:53 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:53 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:54 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:54 devstack sudo[101266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:54 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:54 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 1 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Downloaded image f7074152-6ab5-4285-bfc3-7af082387683 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}])) to volume 69d427bc-6dff-4d44-ad11-e32f4408da65 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Temporary image f7074152-6ab5-4285-bfc3-7af082387683 for user b841cdc03a8341ddb85f4dda49dbfced is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Marking volume 69d427bc-6dff-4d44-ad11-e32f4408da65 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Copying metadata from image f7074152-6ab5-4285-bfc3-7af082387683 to 69d427bc-6dff-4d44-ad11-e32f4408da65. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Creating volume glance metadata for volume 69d427bc-6dff-4d44-ad11-e32f4408da65 backed by image f7074152-6ab5-4285-bfc3-7af082387683 with: {'image_id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'image_name': 'tempest-scenario-img--1520792044', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17186181-f374-4f95-9bd9-47605081ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d427bc-6dff-4d44-ad11-e32f4408da65', 'volume_size': 1, 'image_id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7074152-6ab5-4285-bfc3-7af082387683', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1520792044', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75287f104d444a1cbdf0f0dd41f55447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7074152-6ab5-4285-bfc3-7af082387683', 'created_at': datetime.datetime(2026, 9, 20, 15, 2, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 2, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7074152-6ab5-4285-bfc3-7af082387683/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019580c0e0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f95db6-85d0-406c-8023-66321d18848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Volume volume-69d427bc-6dff-4d44-ad11-e32f4408da65 (69d427bc-6dff-4d44-ad11-e32f4408da65): created successfully
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f95db6-85d0-406c-8023-66321d18848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Flow 'volume_create_manager' (e6320d46-93e3-414f-a6bc-42da66421baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b9f400f8-6e4d-4df5-a1f4-11d14751ffa9 tempest-TestInstancesWithCinderVolumes-1014944988 None] Created volume successfully.
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Flow 'volume_create_manager' (062ee19e-9a9c-4461-a008-310427989300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a726008f-3bdd-411b-97e3-1f3881cf7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a726008f-3bdd-411b-97e3-1f3881cf7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250135979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda87a28-d6ed-480d-b169-c4fcbd07c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143b4c23a34fb9abc5181ae3bc2e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:55Z,use_quota=True,user_id='1473e0a407e249fdb6994fcebd526989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe99458-bfb2-419a-8746-f3c62f9e082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe99458-bfb2-419a-8746-f3c62f9e082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45be566e-6153-48ce-851b-17ab9ff2b37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45be566e-6153-48ce-851b-17ab9ff2b37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fda87a28-d6ed-480d-b169-c4fcbd07c82d', 'volume_name': 'volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01957bd700>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13939e8e-e5bd-4395-9e82-895674cdde1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13939e8e-e5bd-4395-9e82-895674cdde1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7aeb25-6ecb-4236-b847-60af937a5f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:02:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Volume fda87a28-d6ed-480d-b169-c4fcbd07c82d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01957bd700>}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Trying to clone fda87a28-d6ed-480d-b169-c4fcbd07c82d from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:02:55 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Image download 20.69 MB at 20.69 MB/s
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb8335-1dd8-4f9e-b8e4-37a13e75896b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:55 devstack sudo[101273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD
Sep 20 17:02:55 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:56 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 is fetched for user 1473e0a407e249fdb6994fcebd526989. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77bd5c-2572-4792-85d2-50fd78a1b260]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:56 devstack sudo[101278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD
Sep 20 17:02:56 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:56 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250135979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda87a28-d6ed-480d-b169-c4fcbd07c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143b4c23a34fb9abc5181ae3bc2e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:02:55Z,use_quota=True,user_id='1473e0a407e249fdb6994fcebd526989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Creating volume fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:02:56 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:02:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:56 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1073741824
Sep 20 17:02:56 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:57 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1073741824" returned: 0 in 0.496s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:57 devstack sudo[101292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:02:57 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:57 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Attempting download of 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume fda87a28-d6ed-480d-b169-c4fcbd07c82d. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04caf8-5be7-4d9a-a094-90f9130e22a9]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:57 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp
Sep 20 17:02:57 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:57 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp" returned: 0 in 0.394s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:57 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp
Sep 20 17:02:57 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[899e01d1-bac7-46e8-934d-78547d29dc85]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:58 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp" returned: 1 in 0.388s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_wnkpw0dp' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b5a4c-73bc-4191-9d14-9026774928cc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:58 devstack sudo[101313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:02:58 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:58 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:58 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:58 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD
Sep 20 17:02:58 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:58 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.304s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:02:58 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:58 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:02:58 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:02:58 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:58 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:02:58 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:02:59 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Sep 20 17:02:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 1 in 0.467s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:02:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:02:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.960s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:02:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-69d427bc-6dff-4d44-ad11-e32f4408da65', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c8f12ba-fb99-4ad4-b3a4-421d0eb2a3a5', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:02:59 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-52d9ef04-9c2a-4a91-8872-d4e00240d71c req-211ea648-7635-4468-ab73-aca43cc10d60 tempest-TestInstancesWithCinderVolumes-1014944988 None] attachment_update completed successfully.
Sep 20 17:03:00 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 1.910s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_1jihmzxqdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:03:00 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Converted 112.00 MB image at 58.61 MB/s
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:00 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1G
Sep 20 17:03:00 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:00 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 1G" returned: 0 in 0.317s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc1a63c-324d-4d5d-9eaf-c15cafa4d3c8]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:01 devstack sudo[101445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:01 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:01 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 0.696s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:01 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:01 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:02 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 1 in 0.495s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Downloaded image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume fda87a28-d6ed-480d-b169-c4fcbd07c82d successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 for user 1473e0a407e249fdb6994fcebd526989 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Marking volume fda87a28-d6ed-480d-b169-c4fcbd07c82d as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Copying metadata from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 to fda87a28-d6ed-480d-b169-c4fcbd07c82d. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Creating volume glance metadata for volume fda87a28-d6ed-480d-b169-c4fcbd07c82d backed by image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7aeb25-6ecb-4236-b847-60af937a5f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01957bd700>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d594ced4-1a75-42b4-85f7-cc1460913df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:02 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Volume volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d (fda87a28-d6ed-480d-b169-c4fcbd07c82d): created successfully
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d594ced4-1a75-42b4-85f7-cc1460913df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Flow 'volume_create_manager' (062ee19e-9a9c-4461-a008-310427989300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:03:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-424bf38c-0b0c-459e-a3d5-a575e96ff669 tempest-VolumesExtendTest-611064232 None] Created volume successfully.
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ad819-3bbc-44f0-8aa2-7f1d8652ce2c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:02 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:02 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:03 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 0.408s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:03 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:03 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:03 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 1 in 0.384s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 2G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d 2G" returned: 0 in 0.083s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.932s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1ae095f6-d39e-4827-8bdd-a760e2c30937 tempest-VolumesExtendTest-611064232 None] Extend volume completed successfully.
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-fda87a28-d6ed-480d-b169-c4fcbd07c82d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "cinder-fda87a28-d6ed-480d-b169-c4fcbd07c82d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-quobyte-fda87a28-d6ed-480d-b169-c4fcbd07c82d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-fda87a28-d6ed-480d-b169-c4fcbd07c82d" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe41408-7f6c-49ef-bc39-73b9baa012b7]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:04 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:04 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:04 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:04 devstack sudo[101847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:04 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:05 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 1 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:05 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d
Sep 20 17:03:05 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:05 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fda87a28-d6ed-480d-b169-c4fcbd07c82d" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-fda87a28-d6ed-480d-b169-c4fcbd07c82d" released by "delete_volume" :: held 1.258s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Created reservations ['98dbaac3-c90c-4334-aa19-f327f0e34f47', 'c93b3a99-f811-404a-960e-82544f5aba6e', '625676d2-7708-4651-a794-71e4231275e3', '8ed47759-1384-478d-91da-d9bcbb5dad8f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:05 devstack sudo[101858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:05 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:05 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:06 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Deleted volume successfully.
Sep 20 17:03:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-49977c89-5b7b-4d5d-8ec9-df3942f8a08c tempest-VolumesExtendTest-611064232 None] Lock "cinder-fda87a28-d6ed-480d-b169-c4fcbd07c82d-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Flow 'volume_create_manager' (80a8c784-d4dd-4735-839e-986adf621af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777d5f26-ff05-453e-af84-8363ec5f15c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777d5f26-ff05-453e-af84-8363ec5f15c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1697236992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143b4c23a34fb9abc5181ae3bc2e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:03:07Z,use_quota=True,user_id='1473e0a407e249fdb6994fcebd526989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f56d9c-e1ac-413d-a8bc-77ac530f39e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f56d9c-e1ac-413d-a8bc-77ac530f39e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1088b-781c-4d06-883c-20f085186f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1088b-781c-4d06-883c-20f085186f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb', 'volume_name': 'volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cd323d-7f9d-4d82-ba9b-29e16e3c62f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cd323d-7f9d-4d82-ba9b-29e16e3c62f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3186ef-debd-4217-a69d-1baef7b430ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:07 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Volume 8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb', 'volume_size': 1}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1697236992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143b4c23a34fb9abc5181ae3bc2e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:03:07Z,use_quota=True,user_id='1473e0a407e249fdb6994fcebd526989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Creating volume 8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:03:07 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:07 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb 1073741824
Sep 20 17:03:07 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:07 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb 1073741824" returned: 0 in 0.531s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:07 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:07 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:08 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3186ef-debd-4217-a69d-1baef7b430ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c769ec-f600-43e2-8171-736cbb713e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Volume volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb (8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb): created successfully
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c769ec-f600-43e2-8171-736cbb713e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Flow 'volume_create_manager' (80a8c784-d4dd-4735-839e-986adf621af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:03:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5d760a12-9d8f-4dd4-9f52-c362b4dcc2aa tempest-VolumesExtendTest-611064232 None] Created volume successfully.
Sep 20 17:03:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Creating offline snapshot 08d78470-868e-45e5-9e36-c852d4b3e088 of volume 8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:03:09 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc1b1e3-fa2c-46a5-a70e-863a8f1808b4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:09 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:09 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:10 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.462s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:10 devstack sudo[101878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 1G
Sep 20 17:03:10 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:10 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 1G" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:10 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088
Sep 20 17:03:10 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:10 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:10 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 is being set with open permissions: ugo+rw
Sep 20 17:03:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:10 devstack sudo[101890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088
Sep 20 17:03:10 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:11 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:11 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info
Sep 20 17:03:11 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:11 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:11 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info is being set with open permissions: ugo+rw
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:11 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info
Sep 20 17:03:11 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:11 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.info" returned: 0 in 0.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f3864e89-ed7f-42e5-83b3-387d5c6c67e2 tempest-VolumesExtendTest-611064232 None] Create snapshot completed successfully
Sep 20 17:03:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da3bde9-6de7-4842-afad-561d04baa0eb]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:12 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:12 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:13 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 2G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 2G" returned: 0 in 0.114s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.532s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d5961046-9a44-4cb0-9957-3ddd4cfcf3b2 tempest-VolumesExtendTest-611064232 None] Extend volume completed successfully.
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-08d78470-868e-45e5-9e36-c852d4b3e088-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-08d78470-868e-45e5-9e36-c852d4b3e088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-quobyte-08d78470-868e-45e5-9e36-c852d4b3e088" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-08d78470-868e-45e5-9e36-c852d4b3e088" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Deleting offline snapshot 08d78470-868e-45e5-9e36-c852d4b3e088 of volume 8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] snapshot_file for this snap is: volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5985aeeb-d1f1-4ef3-8876-db632618845d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:14 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088
Sep 20 17:03:14 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:14 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088" returned: 0 in 0.371s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555f9f2-f6fc-49fc-9b5f-9e3635728276]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:14 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:14 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:14 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.358s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:14 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088
Sep 20 17:03:14 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:15 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:15 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088
Sep 20 17:03:15 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:15 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb.08d78470-868e-45e5-9e36-c852d4b3e088" returned: 0 in 0.243s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-08d78470-868e-45e5-9e36-c852d4b3e088" released by "_delete_snapshot" :: held 1.442s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" released by "delete_snapshot" :: held 1.473s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Created reservations ['82f4778f-0aa2-437a-a2e1-83a204d3b4f5', 'f8e26631-0a9c-4169-8c89-868a71e9d11f', 'e3f0997d-56d0-43f2-8b93-5f422071df96', 'e4977a26-046c-4cf5-9428-a1829074434f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Delete snapshot completed successfully.
Sep 20 17:03:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d035c49e-e831-4b2a-bc01-6423a79d31a4 tempest-VolumesExtendTest-611064232 None] Lock "cinder-08d78470-868e-45e5-9e36-c852d4b3e088-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "cinder-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Acquiring lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0507d46e-2f7e-4d1d-bdc5-d76f0b009b34]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:16 devstack sudo[101925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:16 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:16 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.385s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:16 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb
Sep 20 17:03:16 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:17 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "cinder-quobyte-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb" released by "delete_volume" :: held 0.741s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Created reservations ['6bdce40e-a44a-49ab-a040-e881a960d67c', 'cacce58e-3032-46a5-ba22-4059feb40cb3', '714ec5cd-5e92-4aa3-9693-014d34f09055', '561852b8-bd33-42d0-8033-152b9b435da0'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:17 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:17 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:17 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.259s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Deleted volume successfully.
Sep 20 17:03:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d9bb3134-8497-4af1-ba6a-5927af9a649f tempest-VolumesExtendTest-611064232 None] Lock "cinder-8e8dc5a9-b3e9-4eff-9deb-f6ac7a155cdb-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Flow 'volume_create_manager' (83b383d1-f850-42af-82ed-d79ff8d8f236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29db485-d802-4d9a-a267-599e60cc7bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29db485-d802-4d9a-a267-599e60cc7bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2066617684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a48797-58b7-49b3-a67f-dbc72fd95673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15f56192394cb88f85db5f05c17361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:03:21Z,use_quota=True,user_id='e33c6ff3b62945e2a70cffe0c18199ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175c84f-5931-4ebd-be97-9537ce484631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175c84f-5931-4ebd-be97-9537ce484631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f50fce-9422-4e7a-9db0-a999b4abdb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f50fce-9422-4e7a-9db0-a999b4abdb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a48797-58b7-49b3-a67f-dbc72fd95673', 'volume_name': 'volume-92a48797-58b7-49b3-a67f-dbc72fd95673', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dce3b4-2415-4f43-959d-8f5a73c79bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dce3b4-2415-4f43-959d-8f5a73c79bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83966619-e1a2-46b6-b935-db3f7b56ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Volume 92a48797-58b7-49b3-a67f-dbc72fd95673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a48797-58b7-49b3-a67f-dbc72fd95673', 'volume_size': 1}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2066617684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a48797-58b7-49b3-a67f-dbc72fd95673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15f56192394cb88f85db5f05c17361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:03:21Z,use_quota=True,user_id='e33c6ff3b62945e2a70cffe0c18199ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Creating volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:03:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:21 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 1073741824
Sep 20 17:03:21 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:21 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 1073741824" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:21 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673
Sep 20 17:03:21 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:22 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673" returned: 0 in 0.246s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83966619-e1a2-46b6-b935-db3f7b56ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a48797-58b7-49b3-a67f-dbc72fd95673', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b0f7d5-c8fd-41e8-8752-e04343601c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:03:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Volume volume-92a48797-58b7-49b3-a67f-dbc72fd95673 (92a48797-58b7-49b3-a67f-dbc72fd95673): created successfully
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b0f7d5-c8fd-41e8-8752-e04343601c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Flow 'volume_create_manager' (83b383d1-f850-42af-82ed-d79ff8d8f236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:03:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-07a97b91-6554-4b6e-be76-e6dd79929615 tempest-VolumesSnapshotListTestJSON-554404856 None] Created volume successfully.
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Creating offline snapshot 05c56b2e-9921-4b07-9fa4-668c849dba1b of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a698849-2b9c-48e4-b5bd-86d82ebd59c7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:22 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673
Sep 20 17:03:22 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:22 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673" returned: 0 in 0.371s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:22 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b 1G
Sep 20 17:03:22 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:23 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b 1G" returned: 0 in 0.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:23 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:23 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:23 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:23 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b is being set with open permissions: ugo+rw
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:23 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:23 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:23 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:23 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info
Sep 20 17:03:23 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:24 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:24 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info is being set with open permissions: ugo+rw
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:24 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info
Sep 20 17:03:24 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:24 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.info" returned: 0 in 0.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-657f4303-2c1e-4816-b4b3-543081f06ba5 tempest-VolumesSnapshotListTestJSON-554404856 None] Create snapshot completed successfully
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Creating offline snapshot b263c780-38ed-405b-8564-34399284bb92 of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c8d1d-3dc7-4002-9490-e72ce058bda5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:24 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:24 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:25 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:25 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 1G
Sep 20 17:03:25 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:25 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 1G" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:25 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:25 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:25 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.299s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:25 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 is being set with open permissions: ugo+rw
Sep 20 17:03:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:25 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:25 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:26 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.240s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.415s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9c1f35aa-705d-49b4-b048-77a6618af33e tempest-VolumesSnapshotListTestJSON-554404856 None] Create snapshot completed successfully
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Creating offline snapshot 7f848a65-f22c-4a66-9b5a-2c605a87fd72 of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41afa62-85b5-444f-8812-6cfdd7908313]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:27 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:27 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:27 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.379s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:27 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 1G
Sep 20 17:03:27 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:27 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 1G" returned: 0 in 0.524s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:28 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72
Sep 20 17:03:28 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:28 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:28 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 is being set with open permissions: ugo+rw
Sep 20 17:03:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:28 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72
Sep 20 17:03:28 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:28 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72" returned: 0 in 0.242s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.556s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bb4a0881-58ee-4643-a2d3-0f77df3fa053 tempest-VolumesSnapshotListTestJSON-554404856 None] Create snapshot completed successfully
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-7f848a65-f22c-4a66-9b5a-2c605a87fd72-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-7f848a65-f22c-4a66-9b5a-2c605a87fd72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-7f848a65-f22c-4a66-9b5a-2c605a87fd72" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-7f848a65-f22c-4a66-9b5a-2c605a87fd72" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Deleting offline snapshot 7f848a65-f22c-4a66-9b5a-2c605a87fd72 of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] snapshot_file for this snap is: volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dda357-ac19-4bd0-ad2a-b41df48b7c08]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:30 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72
Sep 20 17:03:30 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff34b17-6c53-4039-a5b7-ac86bf5add10]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:30 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707
Sep 20 17:03:30 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:30 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72" returned: 0 in 0.387s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6352e08-713b-4808-9290-3fc1172d30f1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:30 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:30 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:30 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.383s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf3c6516-9c2c-4b1a-b7a3-5cd14b2ddb1c', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:03:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-78fea646-745a-4e84-9f11-03a3b336ab2e req-b110d342-c7a6-489e-b02b-daeb14762606 tempest-TestInstancesWithCinderVolumes-1014944988 None] attachment_update completed successfully.
Sep 20 17:03:31 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:31 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72
Sep 20 17:03:31 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:31 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72" returned: 0 in 0.549s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:31 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72
Sep 20 17:03:31 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:31 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.7f848a65-f22c-4a66-9b5a-2c605a87fd72" returned: 0 in 0.249s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-7f848a65-f22c-4a66-9b5a-2c605a87fd72" released by "_delete_snapshot" :: held 1.704s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" released by "delete_snapshot" :: held 1.736s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Created reservations ['2176bdcb-1920-41c3-b317-672411f958cb', '5bab004a-5cc9-4763-b3d7-84fb9fccd414', '30342c5e-d358-4d7e-bcc5-e012458a4359', 'f8db5ace-3820-4440-8444-f396ca2bd9c5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Delete snapshot completed successfully.
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5173bba-f94d-404b-89c7-9234c2261390 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-7f848a65-f22c-4a66-9b5a-2c605a87fd72-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-b263c780-38ed-405b-8564-34399284bb92-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-b263c780-38ed-405b-8564-34399284bb92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-b263c780-38ed-405b-8564-34399284bb92" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-b263c780-38ed-405b-8564-34399284bb92" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Deleting offline snapshot b263c780-38ed-405b-8564-34399284bb92 of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] snapshot_file for this snap is: volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[24295955-6d1b-4ae5-8d6b-887faa88a42b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:32 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:32 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:32 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1bc2f-f139-4c3b-be64-2d2d5b83381e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:32 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:32 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:33 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.402s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:33 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:33 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:33 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:33 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92
Sep 20 17:03:33 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[526380c6-e29e-4bc6-a295-c90b71e5d834]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:33 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af
Sep 20 17:03:33 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:33 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.b263c780-38ed-405b-8564-34399284bb92" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-b263c780-38ed-405b-8564-34399284bb92" released by "_delete_snapshot" :: held 1.564s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" released by "delete_snapshot" :: held 1.589s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Created reservations ['6ffa1d69-cd4a-4bff-bda9-560cbb430103', 'bfa23673-f8f4-4fe7-9915-a5c658117ddf', '20bf05ff-1235-4eb2-8861-42187e24b76a', '1e5780ed-f888-4f8b-b81d-2903683ea089'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Delete snapshot completed successfully.
Sep 20 17:03:34 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af" returned: 0 in 0.374s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.399s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7fb80007-00a8-4f31-867c-028b48e4fce5 tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-b263c780-38ed-405b-8564-34399284bb92-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-f32ac7e1-25a1-4956-8958-c39b1040c1af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '046220fe-9d95-4592-87ee-d8dba0d609f7', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:03:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-395a0a0c-502a-4144-adb4-a8f5efa25d60 req-f9042a8b-9883-46fa-b9b1-9a18d8d79b18 tempest-TestInstancesWithCinderVolumes-1014944988 None] attachment_update completed successfully.
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-05c56b2e-9921-4b07-9fa4-668c849dba1b-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-05c56b2e-9921-4b07-9fa4-668c849dba1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-05c56b2e-9921-4b07-9fa4-668c849dba1b" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-05c56b2e-9921-4b07-9fa4-668c849dba1b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Deleting offline snapshot 05c56b2e-9921-4b07-9fa4-668c849dba1b of volume 92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] snapshot_file for this snap is: volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ccc7de-6d93-461c-9491-9ff832ba421d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:34 devstack sudo[102193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:34 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:34 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a48797-58b7-49b3-a67f-dbc72fd95673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[392bc3e6-acb6-4cd1-a9d4-b9a4d042e051]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:35 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673
Sep 20 17:03:35 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:35 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673" returned: 0 in 0.354s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:35 devstack sudo[102203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:35 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:35 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:35 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b
Sep 20 17:03:35 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:35 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673.05c56b2e-9921-4b07-9fa4-668c849dba1b" returned: 0 in 0.243s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-05c56b2e-9921-4b07-9fa4-668c849dba1b" released by "_delete_snapshot" :: held 1.424s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" released by "delete_snapshot" :: held 1.450s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Created reservations ['323fb1b2-a6e2-40a7-a16f-f7a633ee3bcc', 'de4f851f-e267-492c-8d64-03b7cecfe6c8', '21f7d5ce-5c27-4777-929e-acced5e327ea', '615d67ae-4005-4e2d-b203-e0fceb0f2d5d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Delete snapshot completed successfully.
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82493298-91a0-4047-911c-93263a4334ac tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-05c56b2e-9921-4b07-9fa4-668c849dba1b-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-92a48797-58b7-49b3-a67f-dbc72fd95673-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-92a48797-58b7-49b3-a67f-dbc72fd95673-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f3a961-c2ba-46d5-b77b-8d36420a2b8c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:36 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673
Sep 20 17:03:36 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:37 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673" returned: 0 in 0.384s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:37 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673
Sep 20 17:03:37 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:37 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-92a48797-58b7-49b3-a67f-dbc72fd95673" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-quobyte-92a48797-58b7-49b3-a67f-dbc72fd95673" released by "delete_volume" :: held 0.708s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Created reservations ['cb985123-2750-4f24-ae78-f8725321b851', 'd1ee52d1-6dd7-42b6-892e-02275f2008fc', '6b4bdeb9-6b7d-4dd1-b937-35de10c1ecec', 'b9ead299-e07b-4deb-bda5-26d4028fd9c0'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:37 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:37 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:37 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.244s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Deleted volume successfully.
Sep 20 17:03:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6270e02d-00ab-4d39-a641-476565e420cd tempest-VolumesSnapshotListTestJSON-554404856 None] Lock "cinder-92a48797-58b7-49b3-a67f-dbc72fd95673-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-ccc9256f-e00f-4463-ad72-4b4aa5cc2547 req-2b111364-fe71-45eb-b938-36bf2630a608 tempest-TestInstancesWithCinderVolumes-1014944988 None] Terminate volume connection completed successfully.
Sep 20 17:03:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-ccc9256f-e00f-4463-ad72-4b4aa5cc2547 req-2b111364-fe71-45eb-b938-36bf2630a608 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleting attachment bf3c6516-9c2c-4b1a-b7a3-5cd14b2ddb1c. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-33cbcbdd-4028-4c1c-91de-66eecfc3c707-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-33cbcbdd-4028-4c1c-91de-66eecfc3c707-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-quobyte-33cbcbdd-4028-4c1c-91de-66eecfc3c707" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-33cbcbdd-4028-4c1c-91de-66eecfc3c707" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f2df3-b015-45dc-82f9-c9458f9a556f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:40 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707
Sep 20 17:03:40 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:40 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707" returned: 0 in 0.441s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:40 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707
Sep 20 17:03:40 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:41 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-33cbcbdd-4028-4c1c-91de-66eecfc3c707" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-33cbcbdd-4028-4c1c-91de-66eecfc3c707" released by "delete_volume" :: held 0.794s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:41 devstack cinder-volume[85945]: WARNING cinder.quota [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263851297-2037012111 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263851297-2037012111, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:41 devstack cinder-volume[85945]: WARNING cinder.quota [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263851297-2037012111 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263851297-2037012111, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Created reservations ['9aad53cc-d2c6-4738-85f8-aea4f23c0c4d', 'f58902b7-0411-4471-8f51-5babc90496be', '05b2f464-bff7-4744-be68-01bbcc4aeaae', '0c6e5c15-3319-47e6-9533-09fba37b4283'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:41 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:41 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:41 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.335s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleted volume successfully.
Sep 20 17:03:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9186a6e3-17f5-4778-ba14-7ca26820b612 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-33cbcbdd-4028-4c1c-91de-66eecfc3c707-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-f2f87f39-d8dd-4648-8fec-8f5cb1d8eb15 req-b3066e0e-7c0b-486d-8410-02e7a694cb4b tempest-TestInstancesWithCinderVolumes-1014944988 None] Terminate volume connection completed successfully.
Sep 20 17:03:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-f2f87f39-d8dd-4648-8fec-8f5cb1d8eb15 req-b3066e0e-7c0b-486d-8410-02e7a694cb4b tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleting attachment 046220fe-9d95-4592-87ee-d8dba0d609f7. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-f32ac7e1-25a1-4956-8958-c39b1040c1af-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-f32ac7e1-25a1-4956-8958-c39b1040c1af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-quobyte-f32ac7e1-25a1-4956-8958-c39b1040c1af" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-f32ac7e1-25a1-4956-8958-c39b1040c1af" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9c2760-559a-48a4-8643-0d5d581ef1fc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:45 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af
Sep 20 17:03:45 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:45 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af" returned: 0 in 0.532s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:45 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af
Sep 20 17:03:45 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:46 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f32ac7e1-25a1-4956-8958-c39b1040c1af" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-f32ac7e1-25a1-4956-8958-c39b1040c1af" released by "delete_volume" :: held 0.938s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:46 devstack cinder-volume[85945]: WARNING cinder.quota [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754025807-470294566 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754025807-470294566, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:46 devstack cinder-volume[85945]: WARNING cinder.quota [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754025807-470294566 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754025807-470294566, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Created reservations ['92472551-5f48-4013-96f6-6a11086ab6c1', 'a38323e1-40cb-4e10-b7e7-4c90d1cbb5c4', 'b7ad8907-19af-4ce7-8ab9-9b18a63a10af', '0373f8a4-9734-4e88-9e35-1776c5b30d48'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:46 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:46 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:46 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.290s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleted volume successfully.
Sep 20 17:03:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8eefa503-bdaf-46a4-b20d-0d4fc3abf982 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-f32ac7e1-25a1-4956-8958-c39b1040c1af-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:52 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=97,cinder:INSERT=36,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:03:52 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=109,cinder:UPDATE=100,cinder:INSERT=32,cinder:DELETE=7 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:03:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-993a6717-de73-42d6-9323-85391763de67 req-ed822552-4227-401d-96d4-267e47f802e3 tempest-TestInstancesWithCinderVolumes-1014944988 None] Terminate volume connection completed successfully.
Sep 20 17:03:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-993a6717-de73-42d6-9323-85391763de67 req-ed822552-4227-401d-96d4-267e47f802e3 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleting attachment 1c8f12ba-fb99-4ad4-b3a4-421d0eb2a3a5. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-69d427bc-6dff-4d44-ad11-e32f4408da65-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-69d427bc-6dff-4d44-ad11-e32f4408da65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "cinder-quobyte-69d427bc-6dff-4d44-ad11-e32f4408da65" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-69d427bc-6dff-4d44-ad11-e32f4408da65" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e6ec5f-372e-409c-8d8c-a5087bcce142]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:03:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:54 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:03:54 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:54 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 0.391s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:54 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:03:54 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:54 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 1 in 0.375s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:54 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65
Sep 20 17:03:54 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:54 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-69d427bc-6dff-4d44-ad11-e32f4408da65" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-quobyte-69d427bc-6dff-4d44-ad11-e32f4408da65" released by "delete_volume" :: held 1.116s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:55 devstack cinder-volume[85945]: WARNING cinder.quota [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200754621-1258195671 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200754621-1258195671, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:55 devstack cinder-volume[85945]: WARNING cinder.quota [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200754621-1258195671 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200754621-1258195671, it is now deprecated. Please use the default quota class for default quota.
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Created reservations ['c196acab-7586-4a0c-b376-b2c008448561', '3668eaf1-1491-4320-8b44-7f481421d494', 'c99bb8ee-85e0-4e65-be72-7708566bb973', '2db9201b-0323-44c0-9898-7d1296ca54e9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:55 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:55 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:55 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Deleted volume successfully.
Sep 20 17:03:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b1fb995-8c1f-4b52-922c-28cf628f32c8 tempest-TestInstancesWithCinderVolumes-1014944988 None] Lock "cinder-69d427bc-6dff-4d44-ad11-e32f4408da65-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:03:58 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:03:58 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:03:58 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:03:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Flow 'volume_create_manager' (40ef25bf-4e84-4ec0-822e-b8bea0e992cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15117cff-e0b3-4522-bf14-2bd3a195622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15117cff-e0b3-4522-bf14-2bd3a195622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1310932417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4ed187-75c4-4072-bab2-ebc9e9166a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67edf36f4a54a0bb11a4ac0ee731480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:05Z,use_quota=True,user_id='4cb14602d8804dc882661b0ce151ad42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d94b61e-4a96-4b4a-8ab6-35cf82e3df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d94b61e-4a96-4b4a-8ab6-35cf82e3df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7423d57b-70f2-4395-b1a3-e2fb177b5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:04 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7423d57b-70f2-4395-b1a3-e2fb177b5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'volume_name': 'volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a036d460>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ab6ed0-072e-4c3d-a031-49833aad3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ab6ed0-072e-4c3d-a031-49833aad3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7828de28-cb0b-4de7-9f55-1ba5662b1f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a036d460>}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Trying to clone 3d4ed187-75c4-4072-bab2-ebc9e9166a01 from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:04:05 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Image download 20.69 MB at 20.69 MB/s
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db9714-2d68-4e1d-972f-72b0be7ba350]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:05 devstack sudo[102401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD
Sep 20 17:04:05 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:06 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 is fetched for user 4cb14602d8804dc882661b0ce151ad42. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[536375f1-d1c8-4fed-875a-b8d321c8ecd3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:06 devstack sudo[102406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD
Sep 20 17:04:06 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:06 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1310932417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4ed187-75c4-4072-bab2-ebc9e9166a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67edf36f4a54a0bb11a4ac0ee731480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:05Z,use_quota=True,user_id='4cb14602d8804dc882661b0ce151ad42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Creating volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:04:06 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:06 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1073741824
Sep 20 17:04:06 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:06 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1073741824" returned: 0 in 0.470s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:07 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:07 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:07 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.258s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Attempting download of 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[84500583-d5ed-4e66-9152-0d3e3d5fadc6]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:07 devstack sudo[102421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel
Sep 20 17:04:07 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:07 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:07 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel
Sep 20 17:04:07 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:08 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel" returned: 1 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_5die_bel' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b014f3-5b1b-4612-b4be-ef47894fa796]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:08 devstack sudo[102430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD
Sep 20 17:04:08 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:08 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 was qcow2, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:04:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:08 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:08 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:10 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 1.596s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574f6d20-93ce-4bf6-a8bd-78c991ec7a85_it_o3xrpdevstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:04:10 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Converted 112.00 MB image at 70.13 MB/s
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:10 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1G
Sep 20 17:04:10 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:10 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 1G" returned: 0 in 0.331s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f69ac-001f-4016-9aab-c36df6e0eb81]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:10 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:10 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:10 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.382s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:10 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:10 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:11 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 1 in 0.340s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Downloaded image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 ((None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}])) to volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Temporary image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 for user 4cb14602d8804dc882661b0ce151ad42 is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Marking volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Copying metadata from image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 to 3d4ed187-75c4-4072-bab2-ebc9e9166a01. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Creating volume glance metadata for volume 3d4ed187-75c4-4072-bab2-ebc9e9166a01 backed by image 574f6d20-93ce-4bf6-a8bd-78c991ec7a85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7828de28-cb0b-4de7-9f55-1ba5662b1f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'volume_size': 1, 'image_id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46c5dfb6496743f5a1404a107fabd1e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574f6d20-93ce-4bf6-a8bd-78c991ec7a85', 'created_at': datetime.datetime(2026, 9, 20, 14, 43, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 14, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574f6d20-93ce-4bf6-a8bd-78c991ec7a85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e01a036d460>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d15fe7d-a824-45fd-9ed7-3c038b5b0c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:11 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Volume volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 (3d4ed187-75c4-4072-bab2-ebc9e9166a01): created successfully
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d15fe7d-a824-45fd-9ed7-3c038b5b0c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Flow 'volume_create_manager' (40ef25bf-4e84-4ec0-822e-b8bea0e992cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f779093d-b9b7-44b2-b9ea-31137ce6a584 tempest-TestShelveInstance-1319977416 None] Created volume successfully.
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6bf49e-0d6b-4abe-8dbb-27eb3eb721d0]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:15 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:15 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:15 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.445s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:15 devstack sudo[102476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:15 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:16 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 1 in 0.513s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:04:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9528ca62-58cb-412b-9bb8-54af2fdfdb9e', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:04:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-a886f36d-d3e3-4c74-89c2-fe4ff39d53e0 req-235d7435-487e-4b27-ba36-d13b755fe216 tempest-TestShelveInstance-1319977416 None] attachment_update completed successfully.
Sep 20 17:04:26 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=12,cinder:SELECT=17,cinder:INSERT=13,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:04:26 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Flow 'volume_create_manager' (51f651b1-aaaf-4710-85a6-eddaf35bfd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228babb6-cf41-41e5-87f4-995eef0b0855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228babb6-cf41-41e5-87f4-995eef0b0855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1933352060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88503ce-3317-46e7-a8eb-7b9a9a943011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dfb8b445994cfd9129809b1a0e468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:32Z,use_quota=True,user_id='1bc73b8c7caf4cdc92a818ce328360e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cde719-18ed-4c97-97e3-2bde795562d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cde719-18ed-4c97-97e3-2bde795562d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737670a2-6d3e-4cca-a5aa-1a0a53437245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737670a2-6d3e-4cca-a5aa-1a0a53437245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88503ce-3317-46e7-a8eb-7b9a9a943011', 'volume_name': 'volume-a88503ce-3317-46e7-a8eb-7b9a9a943011', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde54b4-36d7-4326-a993-5d1b4ebcc13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde54b4-36d7-4326-a993-5d1b4ebcc13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beae3204-4e12-40ff-b751-6fc3b97ae873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume a88503ce-3317-46e7-a8eb-7b9a9a943011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88503ce-3317-46e7-a8eb-7b9a9a943011', 'volume_size': 1}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1933352060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88503ce-3317-46e7-a8eb-7b9a9a943011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dfb8b445994cfd9129809b1a0e468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:32Z,use_quota=True,user_id='1bc73b8c7caf4cdc92a818ce328360e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Creating volume a88503ce-3317-46e7-a8eb-7b9a9a943011 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:04:31 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:04:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:31 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 1073741824
Sep 20 17:04:31 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Flow 'volume_create_manager' (735c0a67-5f16-41ec-a16e-b3c46e6a5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ee753d-4d77-46f6-af13-5247d44a8833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ee753d-4d77-46f6-af13-5247d44a8833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1705140631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3f762-7518-400d-ad0a-99e8281bb439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dfb8b445994cfd9129809b1a0e468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:32Z,use_quota=True,user_id='1bc73b8c7caf4cdc92a818ce328360e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb2171-e7a5-42f8-ad8a-8091d5f862ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb2171-e7a5-42f8-ad8a-8091d5f862ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9806d3-1319-47c3-bc57-f034287d26dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9806d3-1319-47c3-bc57-f034287d26dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b3f762-7518-400d-ad0a-99e8281bb439', 'volume_name': 'volume-c6b3f762-7518-400d-ad0a-99e8281bb439', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3259e52-e8cb-4fe9-8f24-a74e3134b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3259e52-e8cb-4fe9-8f24-a74e3134b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83925567-c9e5-483c-9b33-b8c573e3de0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume c6b3f762-7518-400d-ad0a-99e8281bb439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b3f762-7518-400d-ad0a-99e8281bb439', 'volume_size': 1}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:32 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 1073741824" returned: 0 in 0.559s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:32 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011
Sep 20 17:04:32 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:32 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011" returned: 0 in 0.291s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1705140631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3f762-7518-400d-ad0a-99e8281bb439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dfb8b445994cfd9129809b1a0e468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:04:32Z,use_quota=True,user_id='1bc73b8c7caf4cdc92a818ce328360e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Creating volume c6b3f762-7518-400d-ad0a-99e8281bb439 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:04:32 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:32 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 1073741824
Sep 20 17:04:32 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beae3204-4e12-40ff-b751-6fc3b97ae873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88503ce-3317-46e7-a8eb-7b9a9a943011', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a758d6c3-0d4c-4b7e-b4e4-c6186591f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:32 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 (a88503ce-3317-46e7-a8eb-7b9a9a943011): created successfully
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a758d6c3-0d4c-4b7e-b4e4-c6186591f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:32 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Flow 'volume_create_manager' (51f651b1-aaaf-4710-85a6-eddaf35bfd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d375f1c1-89eb-4c63-a34d-cf32a0ce86f8 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Created volume successfully.
Sep 20 17:04:33 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 1073741824" returned: 0 in 0.538s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:33 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439
Sep 20 17:04:33 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:33 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83925567-c9e5-483c-9b33-b8c573e3de0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b3f762-7518-400d-ad0a-99e8281bb439', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf939f18-951f-497f-83e4-dad596d2e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:04:33 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Volume volume-c6b3f762-7518-400d-ad0a-99e8281bb439 (c6b3f762-7518-400d-ad0a-99e8281bb439): created successfully
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf939f18-951f-497f-83e4-dad596d2e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:04:33 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Flow 'volume_create_manager' (735c0a67-5f16-41ec-a16e-b3c46e6a5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:04:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2b65e2c6-cd8c-4445-8317-708828ea66b6 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Created volume successfully.
Sep 20 17:04:43 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:04:43 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:04:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-71b1d6d2-f5a3-484e-aabd-f2a3edbc6206 req-46374016-734d-436a-b2a0-a91c19422643 tempest-TestShelveInstance-1319977416 None] Terminate volume connection completed successfully.
Sep 20 17:04:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-71b1d6d2-f5a3-484e-aabd-f2a3edbc6206 req-46374016-734d-436a-b2a0-a91c19422643 tempest-TestShelveInstance-1319977416 None] Deleting attachment 9528ca62-58cb-412b-9bb8-54af2fdfdb9e. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[20522dae-4e25-4e10-9f90-c2d8f95473fa]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:49 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:49 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:49 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.390s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:49 devstack sudo[103207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:04:49 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:49 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 1 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1f919b4-4c65-44b0-b78c-fb2438dc303b', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:04:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-66888680-e407-4d78-b545-cb8b90059284 req-a960d5d4-70a7-4ed8-bb9c-4b64efdbbe43 tempest-TestShelveInstance-1319977416 None] attachment_update completed successfully.
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:04:58 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:04:58 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:04:58 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:04:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:04:59 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:05:00 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a315e-b4dd-4829-9e83-c0faf476f107]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:03 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011
Sep 20 17:05:03 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:03 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011" returned: 0 in 0.385s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-a88503ce-3317-46e7-a8eb-7b9a9a943011', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '650a101d-5e14-47b0-98c4-abdc37d2e5ee', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:05:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-44271956-e1ba-4367-bbf3-86825332d184 req-cbf4253f-f1ea-48de-80e8-ca5fc863e0b3 tempest-TestServerVolumeAttachmentScenario-1300034522 None] attachment_update completed successfully.
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[630423d0-956c-4023-8d50-c556b0f0ff13]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:07 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439
Sep 20 17:05:07 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:07 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439" returned: 0 in 0.377s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.395s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-c6b3f762-7518-400d-ad0a-99e8281bb439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7243c064-fa48-483c-b5f7-6a5ee871127f', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:05:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-cca9878f-b75b-4173-8a84-bbf746461e31 req-43498aa6-e2a4-456d-b20b-1b716414a388 tempest-TestServerVolumeAttachmentScenario-1300034522 None] attachment_update completed successfully.
Sep 20 17:05:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-3df1b95c-8349-48b8-8b18-adcdfb5357f3 req-1f104908-75a0-4fb2-ab1a-ca87c83e8128 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Terminate volume connection completed successfully.
Sep 20 17:05:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-3df1b95c-8349-48b8-8b18-adcdfb5357f3 req-1f104908-75a0-4fb2-ab1a-ca87c83e8128 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Deleting attachment 7243c064-fa48-483c-b5f7-6a5ee871127f. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:05:11 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-894cd9da-a9e0-445e-a190-517b4287c697 req-5a66c094-ef89-4fae-bc22-8b24cba2e5f2 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Terminate volume connection completed successfully.
Sep 20 17:05:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-894cd9da-a9e0-445e-a190-517b4287c697 req-5a66c094-ef89-4fae-bc22-8b24cba2e5f2 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Deleting attachment 650a101d-5e14-47b0-98c4-abdc37d2e5ee. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "cinder-c6b3f762-7518-400d-ad0a-99e8281bb439-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-c6b3f762-7518-400d-ad0a-99e8281bb439-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "cinder-quobyte-c6b3f762-7518-400d-ad0a-99e8281bb439" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-quobyte-c6b3f762-7518-400d-ad0a-99e8281bb439" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3805f-708b-4fd1-af19-d5902baec1f7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:16 devstack sudo[103861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439
Sep 20 17:05:16 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:16 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439" returned: 0 in 0.350s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:17 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439
Sep 20 17:05:17 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:17 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c6b3f762-7518-400d-ad0a-99e8281bb439" returned: 0 in 0.237s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-quobyte-c6b3f762-7518-400d-ad0a-99e8281bb439" released by "delete_volume" :: held 0.629s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Created reservations ['c3342940-9dd6-43c0-97c2-fd6a4d373813', '03d64a6a-bd7a-4a1f-b0a9-50611ad8d28f', '4f057ae0-990e-4fa6-99ee-1862a68ee9ce', '2ba75a7d-4ed7-4a82-b624-5d9e798b29d9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:17 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:17 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:17 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.231s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Deleted volume successfully.
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ee2ec6a4-9eb8-4cea-8009-e44382723905 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-c6b3f762-7518-400d-ad0a-99e8281bb439-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "cinder-a88503ce-3317-46e7-a8eb-7b9a9a943011-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-a88503ce-3317-46e7-a8eb-7b9a9a943011-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "cinder-quobyte-a88503ce-3317-46e7-a8eb-7b9a9a943011" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-quobyte-a88503ce-3317-46e7-a8eb-7b9a9a943011" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ecfc1-2540-4e7a-8409-67f9c55fa9c5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:17 devstack sudo[103872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011
Sep 20 17:05:17 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:18 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011" returned: 0 in 0.373s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:18 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011
Sep 20 17:05:18 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:18 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a88503ce-3317-46e7-a8eb-7b9a9a943011" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-quobyte-a88503ce-3317-46e7-a8eb-7b9a9a943011" released by "delete_volume" :: held 0.671s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Created reservations ['96ba49bf-d785-4f04-9003-d10efe5d6652', '46c83cdd-3629-4013-863e-e25a4a92558d', 'ee6b700b-6093-404b-a693-9e4731d64d9b', 'b5d2a913-0ec7-4c65-ae8f-38dd347a1ea9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:18 devstack sudo[103884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:18 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:18 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.281s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Deleted volume successfully.
Sep 20 17:05:18 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8aa775a6-a601-4d94-83fa-4ac1105365b1 tempest-TestServerVolumeAttachmentScenario-1300034522 None] Lock "cinder-a88503ce-3317-46e7-a8eb-7b9a9a943011-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-2f5be94b-b6e5-494e-aa79-f7c8553143d7 tempest-TestShelveInstance-1319977416 None] Terminate volume connection completed successfully.
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-2f5be94b-b6e5-494e-aa79-f7c8553143d7 tempest-TestShelveInstance-1319977416 None] Deleting attachment b1f919b4-4c65-44b0-b78c-fb2438dc303b. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Acquiring lock "cinder-3d4ed187-75c4-4072-bab2-ebc9e9166a01-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "cinder-3d4ed187-75c4-4072-bab2-ebc9e9166a01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Acquiring lock "cinder-quobyte-3d4ed187-75c4-4072-bab2-ebc9e9166a01" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "cinder-quobyte-3d4ed187-75c4-4072-bab2-ebc9e9166a01" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0877491b-66fb-443e-890b-4985dfc7b3e6]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:21 devstack sudo[103914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:05:21 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:21 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.441s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:22 devstack sudo[103918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:05:22 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:22 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 1 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:22 devstack sudo[103923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01
Sep 20 17:05:22 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:22 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d4ed187-75c4-4072-bab2-ebc9e9166a01" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "cinder-quobyte-3d4ed187-75c4-4072-bab2-ebc9e9166a01" released by "delete_volume" :: held 1.168s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG cinder.quota [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Created reservations ['80eab3e0-00b3-4919-8caa-b18a022a7a8b', '84f7258a-5147-4b83-8aae-c1f8a7b16f44', 'cd50c1ee-4c68-404e-9e4a-3a6e37bf7505', '96e4b495-4fa8-4d8f-84a9-ad02e4f4103d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:22 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:22 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:23 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:23 devstack cinder-volume[85945]: DEBUG cinder.manager [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Deleted volume successfully.
Sep 20 17:05:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [req-aef89c35-fe4c-49ab-a3d4-a653e5195533 req-e26060d3-1a26-49c9-b5c7-91577586d893 tempest-TestShelveInstance-1319977416 None] Lock "cinder-3d4ed187-75c4-4072-bab2-ebc9e9166a01-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:32 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:05:33 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=33,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Flow 'volume_create_manager' (dcbe1033-8675-4884-b0a1-6405ec36948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469abca6-6d16-4aee-9e49-532439dcf975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469abca6-6d16-4aee-9e49-532439dcf975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176156764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41c4362-109b-4220-a97b-f130201cae94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a0648865411e9ed7aeecd0153275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:36Z,use_quota=True,user_id='6e7f85b3e4214602870cfc95b50be48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ddfabb-33c9-4d9e-8f18-727575068fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ddfabb-33c9-4d9e-8f18-727575068fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a52605-a298-4315-83c6-9173a220b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a52605-a298-4315-83c6-9173a220b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41c4362-109b-4220-a97b-f130201cae94', 'volume_name': 'volume-c41c4362-109b-4220-a97b-f130201cae94', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e85dc23-660b-40b0-a116-d77219daa00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e85dc23-660b-40b0-a116-d77219daa00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0725f1-bd5a-43c6-8838-7b3ccfd4a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:35 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Volume c41c4362-109b-4220-a97b-f130201cae94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41c4362-109b-4220-a97b-f130201cae94', 'volume_size': 1}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176156764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41c4362-109b-4220-a97b-f130201cae94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a0648865411e9ed7aeecd0153275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:36Z,use_quota=True,user_id='6e7f85b3e4214602870cfc95b50be48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Creating volume c41c4362-109b-4220-a97b-f130201cae94 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:05:36 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:36 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 1073741824
Sep 20 17:05:36 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:36 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 1073741824" returned: 0 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:36 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94
Sep 20 17:05:36 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:36 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0725f1-bd5a-43c6-8838-7b3ccfd4a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41c4362-109b-4220-a97b-f130201cae94', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c92c055-3779-48d2-9fa0-195fdac02c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:36 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Volume volume-c41c4362-109b-4220-a97b-f130201cae94 (c41c4362-109b-4220-a97b-f130201cae94): created successfully
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c92c055-3779-48d2-9fa0-195fdac02c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Flow 'volume_create_manager' (dcbe1033-8675-4884-b0a1-6405ec36948f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-588c3858-6cf8-414e-aae3-a27f3dc0db3e tempest-ProjectReaderTests-67131562 None] Created volume successfully.
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Acquiring lock "cinder-c41c4362-109b-4220-a97b-f130201cae94-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "cinder-c41c4362-109b-4220-a97b-f130201cae94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Acquiring lock "cinder-quobyte-c41c4362-109b-4220-a97b-f130201cae94" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "cinder-quobyte-c41c4362-109b-4220-a97b-f130201cae94" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[325323f5-a53c-406e-b18d-2fa4e4dccc21]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:38 devstack sudo[103950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94
Sep 20 17:05:38 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:38 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94" returned: 0 in 0.371s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:38 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94
Sep 20 17:05:38 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:38 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c41c4362-109b-4220-a97b-f130201cae94" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "cinder-quobyte-c41c4362-109b-4220-a97b-f130201cae94" released by "delete_volume" :: held 0.711s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Created reservations ['94f06f38-440b-4bf0-bcdd-7da6e352461a', '77693de6-f906-411e-98b7-a1e5eb757069', 'a18cd20b-fb42-4ecc-aaf5-3c65e4b739a6', 'd9b77b44-9c98-4eb6-8a40-53bfce0d63d0'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:39 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:39 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:39 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Deleted volume successfully.
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f1e5ffd-d95d-40fd-ba8f-7b5e88ecb2c6 tempest-ProjectReaderTests-67131562 None] Lock "cinder-c41c4362-109b-4220-a97b-f130201cae94-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Flow 'volume_create_manager' (1f89ec87-4417-4f78-8e75-df81eb5bf1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0210596-7d8f-4ea6-b3ca-fc78f633872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0210596-7d8f-4ea6-b3ca-fc78f633872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027598971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29857834-de83-434c-9af4-e146d33d5d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a0648865411e9ed7aeecd0153275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:40Z,use_quota=True,user_id='6e7f85b3e4214602870cfc95b50be48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a9fd00-a318-4eeb-ab01-efa89ee5ff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a9fd00-a318-4eeb-ab01-efa89ee5ff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caa42b8-a87f-41f9-9f94-97d0db34c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caa42b8-a87f-41f9-9f94-97d0db34c178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29857834-de83-434c-9af4-e146d33d5d05', 'volume_name': 'volume-29857834-de83-434c-9af4-e146d33d5d05', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d36085-6c3e-4cca-a148-3a831b3eb924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d36085-6c3e-4cca-a148-3a831b3eb924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19658035-8ec6-4236-9f90-b7b757e6eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:40 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Volume 29857834-de83-434c-9af4-e146d33d5d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29857834-de83-434c-9af4-e146d33d5d05', 'volume_size': 1}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027598971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29857834-de83-434c-9af4-e146d33d5d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a0648865411e9ed7aeecd0153275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:40Z,use_quota=True,user_id='6e7f85b3e4214602870cfc95b50be48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Creating volume 29857834-de83-434c-9af4-e146d33d5d05 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:05:40 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:40 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 1073741824
Sep 20 17:05:40 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:40 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 1073741824" returned: 0 in 0.488s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:40 devstack sudo[103968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05
Sep 20 17:05:40 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:40 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19658035-8ec6-4236-9f90-b7b757e6eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29857834-de83-434c-9af4-e146d33d5d05', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0fb747-f58b-415c-a1fa-583f8b56dd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:40 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Volume volume-29857834-de83-434c-9af4-e146d33d5d05 (29857834-de83-434c-9af4-e146d33d5d05): created successfully
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0fb747-f58b-415c-a1fa-583f8b56dd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Flow 'volume_create_manager' (1f89ec87-4417-4f78-8e75-df81eb5bf1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d379ef79-34cb-45bc-ad7d-203e93d0af3b tempest-ProjectReaderTests-67131562 None] Created volume successfully.
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Acquiring lock "cinder-29857834-de83-434c-9af4-e146d33d5d05-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "cinder-29857834-de83-434c-9af4-e146d33d5d05-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Acquiring lock "cinder-quobyte-29857834-de83-434c-9af4-e146d33d5d05" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "cinder-quobyte-29857834-de83-434c-9af4-e146d33d5d05" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736efd8-106f-4881-ad52-a74ea369a6e4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:42 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05
Sep 20 17:05:42 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:42 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:42 devstack sudo[103976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05
Sep 20 17:05:42 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:42 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-29857834-de83-434c-9af4-e146d33d5d05" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "cinder-quobyte-29857834-de83-434c-9af4-e146d33d5d05" released by "delete_volume" :: held 0.692s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Created reservations ['4526653c-bdc6-4975-aed2-35cae86bb15c', '84ffb122-7734-4d60-8e4b-be09bf5fb0c9', 'f6918511-67a7-49fd-8c9c-dca657227a3f', '073cb364-0391-42e3-afe4-404804400416'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:42 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:42 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:43 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:43 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Deleted volume successfully.
Sep 20 17:05:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a70f53d5-079e-4b5e-acb7-dc78d49fe570 tempest-ProjectReaderTests-67131562 None] Lock "cinder-29857834-de83-434c-9af4-e146d33d5d05-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=16,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=6 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Flow 'volume_create_manager' (52f3be10-00d5-4c26-8bab-fa420f69776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdb4ea6-c5ac-46cc-86c4-94d4da377975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdb4ea6-c5ac-46cc-86c4-94d4da377975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1362292173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb3a181-428c-49f5-a09d-755538429a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b853e2e77b41bea4a4cd64eaabaaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:53Z,use_quota=True,user_id='6733a3c952474315a2134b13d5fa7e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7896ff30-5dae-40cf-97ca-d480e628027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7896ff30-5dae-40cf-97ca-d480e628027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb7b96-8c95-4d42-87f4-dd17da730768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb7b96-8c95-4d42-87f4-dd17da730768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb3a181-428c-49f5-a09d-755538429a92', 'volume_name': 'volume-7cb3a181-428c-49f5-a09d-755538429a92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5003697-c3dd-4d58-a61e-82f833faf268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5003697-c3dd-4d58-a61e-82f833faf268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3fbc1a-d309-499b-91a6-6927672eee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Volume 7cb3a181-428c-49f5-a09d-755538429a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb3a181-428c-49f5-a09d-755538429a92', 'volume_size': 1}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1362292173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb3a181-428c-49f5-a09d-755538429a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b853e2e77b41bea4a4cd64eaabaaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:05:53Z,use_quota=True,user_id='6733a3c952474315a2134b13d5fa7e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Creating volume 7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:05:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:53 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 1073741824
Sep 20 17:05:53 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:53 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 1073741824" returned: 0 in 0.449s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:53 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:05:53 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:53 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3fbc1a-d309-499b-91a6-6927672eee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb3a181-428c-49f5-a09d-755538429a92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89aa8d-f800-455a-872f-883edc48a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:05:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Volume volume-7cb3a181-428c-49f5-a09d-755538429a92 (7cb3a181-428c-49f5-a09d-755538429a92): created successfully
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89aa8d-f800-455a-872f-883edc48a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:05:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Flow 'volume_create_manager' (52f3be10-00d5-4c26-8bab-fa420f69776b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:05:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3b1d1624-8130-41e9-a275-894c4e768c40 tempest-TestStampPattern-1841734339 None] Created volume successfully.
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:05:58 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:05:58 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:05:58 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.244s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:05:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:06:03 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=28,cinder:INSERT=5,cinder:SELECT=16,cinder:DELETE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:03 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc170cf-bbed-452f-ad6e-9cccc828f5a7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:06:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:22 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:06:22 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:23 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.383s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-7cb3a181-428c-49f5-a09d-755538429a92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c5b489b-a1b6-4350-b95d-3c7a88888aa4', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:06:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-e6deb86d-fcef-450e-964d-2970c4f8371e req-ed84d87b-3c12-437e-b7ba-f96e98d8fd24 tempest-TestStampPattern-1841734339 None] attachment_update completed successfully.
Sep 20 17:06:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-baa29b5d-7d83-4ab8-93a9-6ea0ec04bed6 req-432ec2b0-0b3d-4b6b-899c-7872e13ac49f tempest-TestStampPattern-1841734339 None] Terminate volume connection completed successfully.
Sep 20 17:06:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-baa29b5d-7d83-4ab8-93a9-6ea0ec04bed6 req-432ec2b0-0b3d-4b6b-899c-7872e13ac49f tempest-TestStampPattern-1841734339 None] Deleting attachment 3c5b489b-a1b6-4350-b95d-3c7a88888aa4. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Creating offline snapshot 39f382e8-ebf1-48a5-827a-7092ecc53531 of volume 7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8d092a-30c8-4aea-8cc4-e3f4fdb1fbfc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:28 devstack sudo[104629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:06:28 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:28 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:29 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 1G
Sep 20 17:06:29 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:29 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 1G" returned: 0 in 0.377s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb3a181-428c-49f5-a09d-755538429a92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:29 devstack sudo[104639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb3a181-428c-49f5-a09d-755538429a92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:06:29 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:29 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb3a181-428c-49f5-a09d-755538429a92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:29 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 is being set with open permissions: ugo+rw
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:29 devstack sudo[104645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:06:29 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:29 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.237s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:29 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info
Sep 20 17:06:29 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:30 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info" returned: 0 in 0.252s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:30 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info is being set with open permissions: ugo+rw
Sep 20 17:06:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:30 devstack sudo[104652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info
Sep 20 17:06:30 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:30 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.info" returned: 0 in 0.231s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8920c12e-b7ff-4a03-b10c-dc7350fe56c2 tempest-TestStampPattern-1841734339 None] Create snapshot completed successfully
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Flow 'volume_create_manager' (7082c96a-9b88-4c00-9f24-7d5075501543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b3d4b7-fca3-4981-bb5e-474b482bc09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b3d4b7-fca3-4981-bb5e-474b482bc09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1342485346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eed0f4f-128f-477b-9b67-46527f643bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b853e2e77b41bea4a4cd64eaabaaf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39f382e8-ebf1-48a5-827a-7092ecc53531,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:06:37Z,use_quota=True,user_id='6733a3c952474315a2134b13d5fa7e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20865ed1-fc69-472f-be15-96f05b9760e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20865ed1-fc69-472f-be15-96f05b9760e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948a5c3a-95b0-4ada-8eec-84fd65dcb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948a5c3a-95b0-4ada-8eec-84fd65dcb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0eed0f4f-128f-477b-9b67-46527f643bf0', 'volume_name': 'volume-0eed0f4f-128f-477b-9b67-46527f643bf0', 'volume_size': 1, 'snapshot_id': '39f382e8-ebf1-48a5-827a-7092ecc53531'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a20aea-eacb-477f-8325-6c68f595bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a20aea-eacb-477f-8325-6c68f595bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279aba2-1467-47b0-b816-3fb151f64beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:37 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Volume 0eed0f4f-128f-477b-9b67-46527f643bf0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0eed0f4f-128f-477b-9b67-46527f643bf0', 'volume_size': 1, 'snapshot_id': '39f382e8-ebf1-48a5-827a-7092ecc53531'}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531-0eed0f4f-128f-477b-9b67-46527f643bf0" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531-0eed0f4f-128f-477b-9b67-46527f643bf0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Creating volume 0eed0f4f-128f-477b-9b67-46527f643bf0 from snapshot 39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] snapshot: 39f382e8-ebf1-48a5-827a-7092ecc53531, volume: 0eed0f4f-128f-477b-9b67-46527f643bf0,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c8306-2f21-4a28-8349-eb8c8cc3811c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:37 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:06:37 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:37 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb3a181-428c-49f5-a09d-755538429a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0fd6e7-0727-4df7-a40b-a7c17c475add]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:06:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:38 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:06:38 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:38 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:38 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:06:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:38 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0
Sep 20 17:06:38 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:46 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0" returned: 0 in 8.203s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb97b12-8fe2-4930-af01-3ce487e90909]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:06:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:46 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:06:46 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:47 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.649s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:06:47 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Converted 1024.00 MB image at 124.81 MB/s
Sep 20 17:06:47 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 is being set with open permissions: ugo+rw
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:47 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0
Sep 20 17:06:47 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:47 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" released by "_copy_volume_from_snapshot" :: held 10.025s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531-0eed0f4f-128f-477b-9b67-46527f643bf0" released by "_create_volume_from_snapshot" :: held 10.057s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.074s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279aba2-1467-47b0-b816-3fb151f64beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eed0f4f-128f-477b-9b67-46527f643bf0', 'volume_size': 1, 'snapshot_id': '39f382e8-ebf1-48a5-827a-7092ecc53531'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d58b06-e29a-4d22-aa44-71f60925f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:06:47 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Volume volume-0eed0f4f-128f-477b-9b67-46527f643bf0 (0eed0f4f-128f-477b-9b67-46527f643bf0): created successfully
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d58b06-e29a-4d22-aa44-71f60925f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:06:47 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Flow 'volume_create_manager' (7082c96a-9b88-4c00-9f24-7d5075501543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:06:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c570381a-ec64-4dd4-b4bb-48281dad570f tempest-TestStampPattern-1841734339 None] Created volume successfully.
Sep 20 17:06:57 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:57 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:06:58 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:06:58 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:06:58 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:06:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b24ad4-1e02-47bd-b2ce-a41d1d9454d5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:27 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0
Sep 20 17:07:27 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:27 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.382s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6', 'name': 'volume-0eed0f4f-128f-477b-9b67-46527f643bf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e45e8bc-f09f-4bde-80aa-8e8c92edaa5b', 'enforce_multipath': True} {{(pid=85945) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 20 17:07:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-7587d072-dfa6-4661-838d-bcc1458791cc req-52e9ed79-93d3-49f3-ad9e-51f8efb51039 tempest-TestStampPattern-1841734339 None] attachment_update completed successfully.
Sep 20 17:07:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [req-60a200eb-8894-49ef-b1d2-72544461f87d req-fadb43ae-3908-407a-af43-b2cc9521e489 tempest-TestStampPattern-1841734339 None] Terminate volume connection completed successfully.
Sep 20 17:07:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [req-60a200eb-8894-49ef-b1d2-72544461f87d req-fadb43ae-3908-407a-af43-b2cc9521e489 tempest-TestStampPattern-1841734339 None] Deleting attachment 1e45e8bc-f09f-4bde-80aa-8e8c92edaa5b. {{(pid=85945) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-0eed0f4f-128f-477b-9b67-46527f643bf0-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "cinder-0eed0f4f-128f-477b-9b67-46527f643bf0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc8f67-5d2c-4814-a1d4-d0bb1badaa7a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:34 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0
Sep 20 17:07:34 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:34 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0" returned: 0 in 0.351s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:34 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0
Sep 20 17:07:34 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:35 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0eed0f4f-128f-477b-9b67-46527f643bf0" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-0eed0f4f-128f-477b-9b67-46527f643bf0" released by "delete_volume" :: held 0.643s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Created reservations ['beec3b87-b696-4a0a-b49d-d441ee50e859', '54d95422-062b-4c05-871a-415d61fc5402', '7429ae0e-d738-4130-bbb9-dc1a684a4f41', 'b97d9d6f-fc60-48e9-a42b-c4fbfdc67844'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:35 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:07:35 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:35 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:07:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Deleted volume successfully.
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-adf175ec-ec42-48b9-a102-da74a1a34932 tempest-TestStampPattern-1841734339 None] Lock "cinder-0eed0f4f-128f-477b-9b67-46527f643bf0-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-39f382e8-ebf1-48a5-827a-7092ecc53531-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-39f382e8-ebf1-48a5-827a-7092ecc53531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Deleting offline snapshot 39f382e8-ebf1-48a5-827a-7092ecc53531 of volume 7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] snapshot_file for this snap is: volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2313210-b9f7-4b47-9717-e20323544b58]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:36 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:07:36 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:36 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb3a181-428c-49f5-a09d-755538429a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4527cd28-a5b7-4b7b-9884-0e9315355da1]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:36 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:07:36 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:36 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:36 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:07:36 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:37 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.321s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:37 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531
Sep 20 17:07:37 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:37 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92.39f382e8-ebf1-48a5-827a-7092ecc53531" returned: 0 in 0.233s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-39f382e8-ebf1-48a5-827a-7092ecc53531" released by "_delete_snapshot" :: held 1.371s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" released by "delete_snapshot" :: held 1.391s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Created reservations ['020d3824-18ad-4d80-be72-34353017409d', '7fafa556-4c98-4f30-9295-58fe075548ae', 'c1ceeb31-670e-4d67-a8ec-b6a9ae62673a', 'dc652588-66ea-46d6-aa64-e12edf4628a2'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:07:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Delete snapshot completed successfully.
Sep 20 17:07:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9bd379f2-37df-423a-84dc-d6facb45a779 tempest-TestStampPattern-1841734339 None] Lock "cinder-39f382e8-ebf1-48a5-827a-7092ecc53531-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-7cb3a181-428c-49f5-a09d-755538429a92-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "cinder-7cb3a181-428c-49f5-a09d-755538429a92-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Acquiring lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e18ef3-f8f5-483d-a659-d68b63d1a367]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:41 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:07:41 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:41 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:41 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92
Sep 20 17:07:41 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:42 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7cb3a181-428c-49f5-a09d-755538429a92" returned: 0 in 0.237s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "cinder-quobyte-7cb3a181-428c-49f5-a09d-755538429a92" released by "delete_volume" :: held 0.646s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Created reservations ['072fec05-e5c9-4e0d-8eec-a36ec1e67555', '0482e8e1-60bb-4d54-9616-5bbeea62552f', '71514059-47ba-4aee-8ce6-a56798a77ddd', 'b360684c-aea0-49e0-bef4-4ef3830c4109'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:42 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:07:42 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:42 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:07:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Deleted volume successfully.
Sep 20 17:07:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4cb215b2-20bc-4500-84f7-be9f34440abd tempest-TestStampPattern-1841734339 None] Lock "cinder-7cb3a181-428c-49f5-a09d-755538429a92-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:07:52 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:07:52 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (7a260da4-4b0a-4572-a8e9-c1aad0019385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b14ec1-494d-4a3b-bb7a-ca8debd766bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b14ec1-494d-4a3b-bb7a-ca8debd766bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495269707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703473f5-3b5d-4aa5-ac16-017a8a8b7089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:53Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac64c2a-576e-4e06-93a6-a093196c1495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac64c2a-576e-4e06-93a6-a093196c1495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5005066d-7343-4d4f-8b7c-4cc8f5a8fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5005066d-7343-4d4f-8b7c-4cc8f5a8fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703473f5-3b5d-4aa5-ac16-017a8a8b7089', 'volume_name': 'volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8765a8-1b84-4572-a052-456f82e297c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8765a8-1b84-4572-a052-456f82e297c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e011da62-2b61-4ead-9d8d-a47b0732aeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume 703473f5-3b5d-4aa5-ac16-017a8a8b7089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089', 'volume_size': 1}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495269707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703473f5-3b5d-4aa5-ac16-017a8a8b7089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:53Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume 703473f5-3b5d-4aa5-ac16-017a8a8b7089 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:53 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 1073741824
Sep 20 17:07:53 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:54 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 1073741824" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:54 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089
Sep 20 17:07:54 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:54 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089" returned: 0 in 0.239s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e011da62-2b61-4ead-9d8d-a47b0732aeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447a4ee-88b4-4b5d-ad15-fe45c3a0e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 (703473f5-3b5d-4aa5-ac16-017a8a8b7089): created successfully
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447a4ee-88b4-4b5d-ad15-fe45c3a0e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (7a260da4-4b0a-4572-a8e9-c1aad0019385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-accfb4e0-741d-4d46-b514-1192b8ac5656 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (de209f98-cd71-4ec8-8193-ae51e69dcd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab93f570-6002-4945-8004-2ab2109c0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab93f570-6002-4945-8004-2ab2109c0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737409113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d82fea-2071-4bc4-9562-0226e3c050ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:55Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b15c8f2-475b-4ab2-8a55-ded06d81d986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b15c8f2-475b-4ab2-8a55-ded06d81d986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b002cec4-a811-4994-aab0-56b35876211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b002cec4-a811-4994-aab0-56b35876211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d82fea-2071-4bc4-9562-0226e3c050ab', 'volume_name': 'volume-73d82fea-2071-4bc4-9562-0226e3c050ab', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d318ee0-4035-4fe4-a9ab-659237a34068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d318ee0-4035-4fe4-a9ab-659237a34068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760e25d6-c88b-438e-9f8c-380f034cc8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume 73d82fea-2071-4bc4-9562-0226e3c050ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d82fea-2071-4bc4-9562-0226e3c050ab', 'volume_size': 1}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737409113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d82fea-2071-4bc4-9562-0226e3c050ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:55Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume 73d82fea-2071-4bc4-9562-0226e3c050ab {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:55 devstack sudo[105455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab 1073741824
Sep 20 17:07:55 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (6680e60a-13d8-45f1-b5a4-73368046f3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b88ca74-7950-4d0c-a3f7-e8c630a2fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b88ca74-7950-4d0c-a3f7-e8c630a2fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099550824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598ed9c6-1591-4dd3-a9bd-53353b513424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:55Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86423224-3d4d-4b43-905b-6ff9a3980925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86423224-3d4d-4b43-905b-6ff9a3980925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326376df-7b5f-4788-a264-2f4a7526cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326376df-7b5f-4788-a264-2f4a7526cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598ed9c6-1591-4dd3-a9bd-53353b513424', 'volume_name': 'volume-598ed9c6-1591-4dd3-a9bd-53353b513424', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27faa7a-12cd-4655-8317-a8f920ece959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27faa7a-12cd-4655-8317-a8f920ece959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1ba263-8ed7-4609-ac2a-401d44039654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume 598ed9c6-1591-4dd3-a9bd-53353b513424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598ed9c6-1591-4dd3-a9bd-53353b513424', 'volume_size': 1}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:55 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab 1073741824" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:55 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab
Sep 20 17:07:55 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (3385b24c-9a39-422a-ab00-c21fc0983db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd291452-d780-4176-9341-50d539ff2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd291452-d780-4176-9341-50d539ff2141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388893573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f10d78-8aef-4412-a11e-9977bd2c0f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812c1987-48f9-4753-854e-c435fa1c8dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812c1987-48f9-4753-854e-c435fa1c8dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da01661-321c-448f-8fc8-024bd8eb5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da01661-321c-448f-8fc8-024bd8eb5b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f10d78-8aef-4412-a11e-9977bd2c0f8c', 'volume_name': 'volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cab58e-1032-4ae1-baab-4808684154d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cab58e-1032-4ae1-baab-4808684154d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117575bc-d1be-4462-88c5-2be91b66a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume 22f10d78-8aef-4412-a11e-9977bd2c0f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c', 'volume_size': 1}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:55 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099550824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598ed9c6-1591-4dd3-a9bd-53353b513424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:55Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume 598ed9c6-1591-4dd3-a9bd-53353b513424 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760e25d6-c88b-438e-9f8c-380f034cc8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d82fea-2071-4bc4-9562-0226e3c050ab', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 1073741824
Sep 20 17:07:55 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3d55b-6045-42f1-8951-fa981529733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-73d82fea-2071-4bc4-9562-0226e3c050ab (73d82fea-2071-4bc4-9562-0226e3c050ab): created successfully
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3d55b-6045-42f1-8951-fa981529733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (de209f98-cd71-4ec8-8193-ae51e69dcd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6c3ffbe9-20ed-4d08-8ca6-a50732f1468b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (1ed710d3-ef93-414e-896a-6b3513356fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a30fb-3a78-4548-bbd0-232d01c66c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a30fb-3a78-4548-bbd0-232d01c66c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399562934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6be56dd-093c-48ed-981c-558b2370e700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f2d1e2-a0d3-4ca9-9763-743600cac9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f2d1e2-a0d3-4ca9-9763-743600cac9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9070434f-32e2-4e6e-8774-db4320be90f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9070434f-32e2-4e6e-8774-db4320be90f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6be56dd-093c-48ed-981c-558b2370e700', 'volume_name': 'volume-f6be56dd-093c-48ed-981c-558b2370e700', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece5db49-6eb6-4664-a7b1-352f41664891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece5db49-6eb6-4664-a7b1-352f41664891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f0a19-6bb2-44e0-a2ee-3239a643f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume f6be56dd-093c-48ed-981c-558b2370e700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6be56dd-093c-48ed-981c-558b2370e700', 'volume_size': 1}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:56 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 1073741824" returned: 0 in 0.496s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:56 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424
Sep 20 17:07:56 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (3297e292-4381-4d3c-894f-65bec2d409e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815fc64-7aef-4ca2-bfea-0400de87357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815fc64-7aef-4ca2-bfea-0400de87357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710859383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abe7c89-5158-4f05-84d4-2a4760f94409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba328c58-1e4d-47d4-97f0-8c820e730f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba328c58-1e4d-47d4-97f0-8c820e730f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cc2087-5e83-47ba-9969-6d4b4176060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cc2087-5e83-47ba-9969-6d4b4176060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abe7c89-5158-4f05-84d4-2a4760f94409', 'volume_name': 'volume-0abe7c89-5158-4f05-84d4-2a4760f94409', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9009b135-096e-4ccc-a8a5-01cb661ba558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9009b135-096e-4ccc-a8a5-01cb661ba558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2d41ae-6319-4380-a786-db947f14e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume 0abe7c89-5158-4f05-84d4-2a4760f94409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abe7c89-5158-4f05-84d4-2a4760f94409', 'volume_size': 1}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:56 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424" returned: 0 in 0.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388893573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f10d78-8aef-4412-a11e-9977bd2c0f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume 22f10d78-8aef-4412-a11e-9977bd2c0f8c {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:56 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c 1073741824
Sep 20 17:07:56 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1ba263-8ed7-4609-ac2a-401d44039654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598ed9c6-1591-4dd3-a9bd-53353b513424', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbf2e88-4adc-4d41-bc1a-f3778b702c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-598ed9c6-1591-4dd3-a9bd-53353b513424 (598ed9c6-1591-4dd3-a9bd-53353b513424): created successfully
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbf2e88-4adc-4d41-bc1a-f3778b702c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (6680e60a-13d8-45f1-b5a4-73368046f3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-acb63a4d-ed0a-43a0-9f7c-53ebfe196c96 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:57 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c 1073741824" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:57 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c
Sep 20 17:07:57 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:57 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399562934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6be56dd-093c-48ed-981c-558b2370e700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume f6be56dd-093c-48ed-981c-558b2370e700 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:57 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117575bc-d1be-4462-88c5-2be91b66a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a32042-5a73-4fd0-a9a6-c89d0504ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:57 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 1073741824
Sep 20 17:07:57 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:57 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c (22f10d78-8aef-4412-a11e-9977bd2c0f8c): created successfully
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a32042-5a73-4fd0-a9a6-c89d0504ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (3385b24c-9a39-422a-ab00-c21fc0983db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-700d6802-ec68-4d0c-b38c-6ae53e961cb0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:57 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 1073741824" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:57 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700
Sep 20 17:07:57 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:58 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700" returned: 0 in 0.237s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710859383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abe7c89-5158-4f05-84d4-2a4760f94409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02db8fa0e5f4868805e5f79bd7a1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:07:56Z,use_quota=True,user_id='b7e288e05dd74ef29e55dffafffb332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Creating volume 0abe7c89-5158-4f05-84d4-2a4760f94409 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:07:58 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f0a19-6bb2-44e0-a2ee-3239a643f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6be56dd-093c-48ed-981c-558b2370e700', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352eb33-0d72-4977-8948-a193691bd879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:58 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 1073741824
Sep 20 17:07:58 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-f6be56dd-093c-48ed-981c-558b2370e700 (f6be56dd-093c-48ed-981c-558b2370e700): created successfully
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352eb33-0d72-4977-8948-a193691bd879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (1ed710d3-ef93-414e-896a-6b3513356fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d4c3306b-c079-4c87-a847-108c640f05df tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:58 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:07:58 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:58 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:07:58 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 1073741824" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:07:58 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409
Sep 20 17:07:58 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:07:58 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2d41ae-6319-4380-a786-db947f14e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abe7c89-5158-4f05-84d4-2a4760f94409', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481566f0-e2ff-486a-8dfa-1b10573feba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:07:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Volume volume-0abe7c89-5158-4f05-84d4-2a4760f94409 (0abe7c89-5158-4f05-84d4-2a4760f94409): created successfully
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481566f0-e2ff-486a-8dfa-1b10573feba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:07:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Flow 'volume_create_manager' (3297e292-4381-4d3c-894f-65bec2d409e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:07:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-fcb90482-66f2-4093-aec9-93dd310b9a25 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created volume successfully.
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-0abe7c89-5158-4f05-84d4-2a4760f94409-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-0abe7c89-5158-4f05-84d4-2a4760f94409-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-0abe7c89-5158-4f05-84d4-2a4760f94409" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-0abe7c89-5158-4f05-84d4-2a4760f94409" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab9303-f0b0-4e30-90ef-34a6d95ecb59]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:07:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:00 devstack sudo[105536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409
Sep 20 17:08:00 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:00 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:00 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409
Sep 20 17:08:00 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:00 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0abe7c89-5158-4f05-84d4-2a4760f94409" returned: 0 in 0.238s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-0abe7c89-5158-4f05-84d4-2a4760f94409" released by "delete_volume" :: held 0.624s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['09d98615-0342-4d1a-962b-c33ff0a91cc0', '84558110-d9a6-4a49-9368-1a86dbb66387', 'f1687b65-8cb0-4d9d-a207-84306b2b90b5', '51820a77-fe5c-41d8-b4e2-3dd8b6668433'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:00 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:00 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:00 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.240s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1383a065-9f4e-4b09-b2a5-180efad2c87f tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-0abe7c89-5158-4f05-84d4-2a4760f94409-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-f6be56dd-093c-48ed-981c-558b2370e700-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-f6be56dd-093c-48ed-981c-558b2370e700-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-f6be56dd-093c-48ed-981c-558b2370e700" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-f6be56dd-093c-48ed-981c-558b2370e700" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[17abdb79-85fe-4a3a-a9da-e18114aec759]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:01 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700
Sep 20 17:08:01 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:01 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:01 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700
Sep 20 17:08:01 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:01 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f6be56dd-093c-48ed-981c-558b2370e700" returned: 0 in 0.239s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-f6be56dd-093c-48ed-981c-558b2370e700" released by "delete_volume" :: held 0.631s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['a82d152d-4337-42a2-84b1-4103544b0951', 'd0c4f2b2-688d-4066-ab55-a8870ca557b6', '95c32d60-7f76-4c75-b731-842740f538fe', 'c856f3ce-af9c-4342-8eb0-7fa39d031f08'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:01 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:01 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:02 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.270s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-efb60d45-96ef-4b1b-a81b-5b4e56aeab3b tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-f6be56dd-093c-48ed-981c-558b2370e700-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-22f10d78-8aef-4412-a11e-9977bd2c0f8c-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-22f10d78-8aef-4412-a11e-9977bd2c0f8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-22f10d78-8aef-4412-a11e-9977bd2c0f8c" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-22f10d78-8aef-4412-a11e-9977bd2c0f8c" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bda034-7034-48fe-9365-b83e87be1130]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:02 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c
Sep 20 17:08:02 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:02 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:02 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c
Sep 20 17:08:02 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:02 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-22f10d78-8aef-4412-a11e-9977bd2c0f8c" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-22f10d78-8aef-4412-a11e-9977bd2c0f8c" released by "delete_volume" :: held 0.663s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:02 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['aee0a7bd-5a86-454b-8482-fc829cc96b9c', 'd65a5518-bf3f-401d-a0cc-cec72918141b', '2063a6e8-2a90-4c9f-858f-f573b00bc3e8', 'd8b24c33-00b4-4100-951d-d6f3ff9d5084'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:03 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:03 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:03 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:03 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-baf63d2a-5dd0-412a-9bd8-62f30bf454bb tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-22f10d78-8aef-4412-a11e-9977bd2c0f8c-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-598ed9c6-1591-4dd3-a9bd-53353b513424-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-598ed9c6-1591-4dd3-a9bd-53353b513424-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-598ed9c6-1591-4dd3-a9bd-53353b513424" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-598ed9c6-1591-4dd3-a9bd-53353b513424" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3654039-9964-428a-8dd1-42af3878db23]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:03 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424
Sep 20 17:08:03 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:03 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424" returned: 0 in 0.371s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:03 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424
Sep 20 17:08:03 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:04 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-598ed9c6-1591-4dd3-a9bd-53353b513424" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-598ed9c6-1591-4dd3-a9bd-53353b513424" released by "delete_volume" :: held 0.670s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['e0019a7c-c6ee-4d73-82b5-25ea3b8399b4', '88a5bf0d-dfd9-4bba-8aa6-ad1aa2be9c2c', '9fb90aaa-ee44-42d8-95f9-e40db032db27', '17701338-731c-49cb-9fa6-5713f9b1ec55'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:04 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:04 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:04 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3beef833-8b06-46cf-8b2a-92b020a9a27a tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-598ed9c6-1591-4dd3-a9bd-53353b513424-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-73d82fea-2071-4bc4-9562-0226e3c050ab-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-73d82fea-2071-4bc4-9562-0226e3c050ab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-73d82fea-2071-4bc4-9562-0226e3c050ab" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-73d82fea-2071-4bc4-9562-0226e3c050ab" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b0278-a6e0-4e06-b4ad-df9464959343]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:04 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab
Sep 20 17:08:04 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:04 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab" returned: 0 in 0.346s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:04 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab
Sep 20 17:08:04 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:05 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-73d82fea-2071-4bc4-9562-0226e3c050ab" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-73d82fea-2071-4bc4-9562-0226e3c050ab" released by "delete_volume" :: held 0.624s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['31057009-9822-481c-98f8-50a8805ae8c8', '705d7362-892e-4152-a5bb-7f737d17b77b', '65e8bcd4-5f78-4ef7-bad3-2e4b3db12563', '9b9c6da8-f873-48eb-ae63-88ef5cb75c7b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:05 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:05 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:05 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.243s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b2b77439-d8a7-4685-b887-da0e9434f2f0 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-73d82fea-2071-4bc4-9562-0226e3c050ab-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-703473f5-3b5d-4aa5-ac16-017a8a8b7089-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-703473f5-3b5d-4aa5-ac16-017a8a8b7089-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "cinder-quobyte-703473f5-3b5d-4aa5-ac16-017a8a8b7089" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-703473f5-3b5d-4aa5-ac16-017a8a8b7089" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e62a315-6ab8-482a-aff5-6e91c7a3c997]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:05 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089
Sep 20 17:08:05 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:06 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:06 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089
Sep 20 17:08:06 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:06 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-703473f5-3b5d-4aa5-ac16-017a8a8b7089" returned: 0 in 0.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-quobyte-703473f5-3b5d-4aa5-ac16-017a8a8b7089" released by "delete_volume" :: held 0.670s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Created reservations ['2db32177-de49-4a94-8607-08badacbaafc', 'c3f50488-3805-4852-9016-bac2484d5a18', '8eb0fcc6-efcb-4119-b1e0-f0c7e9819bfa', 'b1677802-62f4-43f3-a365-f3786194e3de'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:06 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:06 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:06 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Deleted volume successfully.
Sep 20 17:08:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3ad45d6f-81eb-49ef-b065-2f5592f76576 tempest-CreateVolumesFromSourceVolumeTest-1302100789 None] Lock "cinder-703473f5-3b5d-4aa5-ac16-017a8a8b7089-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Flow 'volume_create_manager' (5d07ef7b-5d03-4b9a-803d-15de5cc82fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601bb217-15de-48f4-a30a-3e0ef2e42df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601bb217-15de-48f4-a30a-3e0ef2e42df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849705159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77595c4c-bcc2-4f3e-aa22-609d58bc5b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cec16ae72464ae7bbeb27de39251595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:10Z,use_quota=True,user_id='ff2680c6fa2f4313961d213ffaf1b9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22b8c46-2e4f-4987-943f-603e92640966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22b8c46-2e4f-4987-943f-603e92640966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af7eebd-817a-4e28-8bb0-8d92a1383c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af7eebd-817a-4e28-8bb0-8d92a1383c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77595c4c-bcc2-4f3e-aa22-609d58bc5b41', 'volume_name': 'volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d1e120-7555-4ef7-bf7c-8f8aa881ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d1e120-7555-4ef7-bf7c-8f8aa881ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b14c99e-56f6-4c1b-8fdf-46d71a75bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:09 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Volume 77595c4c-bcc2-4f3e-aa22-609d58bc5b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41', 'volume_size': 1}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849705159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77595c4c-bcc2-4f3e-aa22-609d58bc5b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cec16ae72464ae7bbeb27de39251595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:10Z,use_quota=True,user_id='ff2680c6fa2f4313961d213ffaf1b9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Creating volume 77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:09 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:09 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 1073741824
Sep 20 17:08:09 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:10 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 1073741824" returned: 0 in 0.398s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:10 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:10 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:10 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.231s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b14c99e-56f6-4c1b-8fdf-46d71a75bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4680a4-6092-4fbc-aa09-ef8b76e60f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:10 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Volume volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 (77595c4c-bcc2-4f3e-aa22-609d58bc5b41): created successfully
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4680a4-6092-4fbc-aa09-ef8b76e60f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Flow 'volume_create_manager' (5d07ef7b-5d03-4b9a-803d-15de5cc82fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e12adab8-670e-4a7e-bbdc-de30611b64ad tempest-VolumeDependencyTests-2039378664 None] Created volume successfully.
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Creating offline snapshot d60ef2cb-dcc7-4178-8c5b-0c436cae659d of volume 77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f8b0a-000a-4af8-a78e-cea0a17e47c9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:11 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:11 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:11 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:11 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d 1G
Sep 20 17:08:11 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:11 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d 1G" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:11 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:11 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:11 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:11 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d is being set with open permissions: ugo+rw
Sep 20 17:08:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:11 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:11 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:12 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.233s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:12 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info
Sep 20 17:08:12 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:12 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:12 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info is being set with open permissions: ugo+rw
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:12 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info
Sep 20 17:08:12 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:12 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.info" returned: 0 in 0.231s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-46442aa0-952f-47ad-863b-51f6bfbaf2af tempest-VolumeDependencyTests-2039378664 None] Create snapshot completed successfully
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Flow 'volume_create_manager' (f5eff697-3718-41eb-9f58-8a5af7330655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633b0d11-16eb-494f-b3ae-cd72fd6f1c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633b0d11-16eb-494f-b3ae-cd72fd6f1c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881449991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8128a50f-1af9-441f-ac7c-99a969a8d82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cec16ae72464ae7bbeb27de39251595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d60ef2cb-dcc7-4178-8c5b-0c436cae659d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:13Z,use_quota=True,user_id='ff2680c6fa2f4313961d213ffaf1b9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd0bc96-51d5-420b-a455-e0ad05f7a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd0bc96-51d5-420b-a455-e0ad05f7a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b89350-5c86-4269-8150-402ded37e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b89350-5c86-4269-8150-402ded37e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8128a50f-1af9-441f-ac7c-99a969a8d82e', 'volume_name': 'volume-8128a50f-1af9-441f-ac7c-99a969a8d82e', 'volume_size': 1, 'snapshot_id': 'd60ef2cb-dcc7-4178-8c5b-0c436cae659d'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc2de8a-d3b8-4428-972f-152e59faba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc2de8a-d3b8-4428-972f-152e59faba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f1961a-2f85-4fb5-a802-02ccc8a28c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Volume 8128a50f-1af9-441f-ac7c-99a969a8d82e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8128a50f-1af9-441f-ac7c-99a969a8d82e', 'volume_size': 1, 'snapshot_id': 'd60ef2cb-dcc7-4178-8c5b-0c436cae659d'}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-8128a50f-1af9-441f-ac7c-99a969a8d82e" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-8128a50f-1af9-441f-ac7c-99a969a8d82e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Creating volume 8128a50f-1af9-441f-ac7c-99a969a8d82e from snapshot d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] snapshot: d60ef2cb-dcc7-4178-8c5b-0c436cae659d, volume: 8128a50f-1af9-441f-ac7c-99a969a8d82e,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[20876c7b-5c0b-4224-8699-475d0ab94380]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:13 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:13 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:14 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbef818-dd63-4abe-863c-2d2f8c4c37c9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:14 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:14 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:14 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:08:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:14 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e
Sep 20 17:08:14 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:19 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e" returned: 0 in 5.506s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:19 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed6307-35c4-468d-a4ac-68944b91d6d6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:20 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:20 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:20 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.508s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:08:20 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Converted 1024.00 MB image at 185.92 MB/s
Sep 20 17:08:20 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e is being set with open permissions: ugo+rw
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:20 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e
Sep 20 17:08:20 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:20 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e" returned: 0 in 0.224s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" released by "_copy_volume_from_snapshot" :: held 7.016s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-8128a50f-1af9-441f-ac7c-99a969a8d82e" released by "_create_volume_from_snapshot" :: held 7.043s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.057s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f1961a-2f85-4fb5-a802-02ccc8a28c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8128a50f-1af9-441f-ac7c-99a969a8d82e', 'volume_size': 1, 'snapshot_id': 'd60ef2cb-dcc7-4178-8c5b-0c436cae659d'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5345ec97-7342-4ae4-90eb-a2ca5279fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Volume volume-8128a50f-1af9-441f-ac7c-99a969a8d82e (8128a50f-1af9-441f-ac7c-99a969a8d82e): created successfully
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5345ec97-7342-4ae4-90eb-a2ca5279fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Flow 'volume_create_manager' (f5eff697-3718-41eb-9f58-8a5af7330655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1b03167e-4d8b-4bfa-b2f9-77eb708982b6 tempest-VolumeDependencyTests-2039378664 None] Created volume successfully.
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Deleting offline snapshot d60ef2cb-dcc7-4178-8c5b-0c436cae659d of volume 77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] snapshot_file for this snap is: volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad034c-2948-45d5-a8a1-d4c5240e184b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:21 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:21 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:21 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88ef38-b266-4cc5-8bab-89188ba23601]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:21 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:21 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:21 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.332s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:21 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:21 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:22 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:22 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d
Sep 20 17:08:22 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:22 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41.d60ef2cb-dcc7-4178-8c5b-0c436cae659d" returned: 0 in 0.236s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-d60ef2cb-dcc7-4178-8c5b-0c436cae659d" released by "_delete_snapshot" :: held 1.351s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" released by "delete_snapshot" :: held 1.371s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Created reservations ['bc0f7411-8b8b-4131-b0d6-ec8321af4b7b', '556c058f-5605-4f3f-9b63-241e792338d5', '139b8402-ea1f-4e7d-8798-2786f2a5e2ed', '9fcb18e4-a802-4699-9bbf-80526c9e0b95'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Delete snapshot completed successfully.
Sep 20 17:08:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-171a5ef8-72f2-4478-bb54-3197091dd419 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-d60ef2cb-dcc7-4178-8c5b-0c436cae659d-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-77595c4c-bcc2-4f3e-aa22-609d58bc5b41-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-77595c4c-bcc2-4f3e-aa22-609d58bc5b41-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b76a9-aa22-4613-b569-631edb1a95f0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:23 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:23 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:23 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:23 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41
Sep 20 17:08:23 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:23 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-77595c4c-bcc2-4f3e-aa22-609d58bc5b41" released by "delete_volume" :: held 0.689s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:23 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Created reservations ['2657d1e7-32f4-4982-ab35-0596a950c8d3', 'aabf09bb-5424-4963-a916-b846dfcea362', '35ff78e0-d4b8-4bd1-92f5-890fa0730bf7', '1e6bb86e-834d-494b-ab43-913cfb699f81'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:24 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:24 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:24 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.266s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Deleted volume successfully.
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-8128a50f-1af9-441f-ac7c-99a969a8d82e-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9fdaf576-491e-41a3-9348-dc90a09a979d tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-77595c4c-bcc2-4f3e-aa22-609d58bc5b41-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-8128a50f-1af9-441f-ac7c-99a969a8d82e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b118ac-3f41-4819-8eb5-880810291a31]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:24 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e
Sep 20 17:08:24 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:24 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e" returned: 0 in 0.374s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:24 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e
Sep 20 17:08:24 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:25 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8128a50f-1af9-441f-ac7c-99a969a8d82e" returned: 0 in 0.237s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-quobyte-8128a50f-1af9-441f-ac7c-99a969a8d82e" released by "delete_volume" :: held 0.653s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Created reservations ['42b5393f-e654-4c83-853e-67cd6489ae69', 'b68db4d1-39a6-4932-b1ce-8ed7fdbc5282', '7383ec85-6e09-4c8f-8071-23ad0b37beba', 'bd7bb72f-6320-4cb4-87c0-3274bf0e6cc5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:25 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:25 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:25 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Deleted volume successfully.
Sep 20 17:08:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9113d818-417c-4bdc-994f-d5eeb55efab0 tempest-VolumeDependencyTests-2039378664 None] Lock "cinder-8128a50f-1af9-441f-ac7c-99a969a8d82e-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Flow 'volume_create_manager' (fbe28be6-1527-43db-8089-2be9cc4284ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf42937-40d3-4684-afb2-a3475ce59e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf42937-40d3-4684-afb2-a3475ce59e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe064aad-0220-49c8-9222-d97a20d956ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f54554b8df545e1b3e256b7b70e2a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:31Z,use_quota=True,user_id='694fbd31200c4bebbc2d04da6d873f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798bd0b1-47e4-4ccf-b72d-ed6b97e7b8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798bd0b1-47e4-4ccf-b72d-ed6b97e7b8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f5f2b7-7f8a-4168-9383-5b9a9944d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f5f2b7-7f8a-4168-9383-5b9a9944d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe064aad-0220-49c8-9222-d97a20d956ba', 'volume_name': 'volume-fe064aad-0220-49c8-9222-d97a20d956ba', 'volume_size': 1, 'image_id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f489ca6e6e12fd6359a0a8595508b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f54554b8df545e1b3e256b7b70e2a02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db9691c627d5f3a14e5a00ed497e2684f7c65aff4b0a0d4d8ae4dde1b9446daf31803722146c102f3e8edcb7142aa7a294202d78979d173a28c1b3791d4161d8', 'id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'created_at': datetime.datetime(2026, 9, 20, 15, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 8, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7991987-47d4-4b4b-afb1-42be508f2fa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc28050>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5d16ce-54bd-4f07-9440-82f3d6eb4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5d16ce-54bd-4f07-9440-82f3d6eb4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a983a4-cc90-48c1-af7f-dda22ea226d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:30 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Volume fe064aad-0220-49c8-9222-d97a20d956ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe064aad-0220-49c8-9222-d97a20d956ba', 'volume_size': 1, 'image_id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f489ca6e6e12fd6359a0a8595508b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f54554b8df545e1b3e256b7b70e2a02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db9691c627d5f3a14e5a00ed497e2684f7c65aff4b0a0d4d8ae4dde1b9446daf31803722146c102f3e8edcb7142aa7a294202d78979d173a28c1b3791d4161d8', 'id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'created_at': datetime.datetime(2026, 9, 20, 15, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 8, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7991987-47d4-4b4b-afb1-42be508f2fa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc28050>}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Trying to clone fe064aad-0220-49c8-9222-d97a20d956ba from image c7991987-47d4-4b4b-afb1-42be508f2fa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:08:30 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:08:30 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Image download 0.00 MB at 0.00 MB/s
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412d074-7752-4f86-a16e-6234001bb40a]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:31 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:31 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:31 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:31 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:31 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:31 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Temporary image c7991987-47d4-4b4b-afb1-42be508f2fa4 is fetched for user 694fbd31200c4bebbc2d04da6d873f9a. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c735f5-16d5-43a9-af7c-476d0807d9a4]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:31 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:31 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:32 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:32 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:32 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:32 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe064aad-0220-49c8-9222-d97a20d956ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f54554b8df545e1b3e256b7b70e2a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:31Z,use_quota=True,user_id='694fbd31200c4bebbc2d04da6d873f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Creating volume fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:32 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:32 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1073741824
Sep 20 17:08:32 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:32 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1073741824" returned: 0 in 0.418s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:32 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:32 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:33 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 0 in 0.245s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Attempting download of c7991987-47d4-4b4b-afb1-42be508f2fa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}])) to volume fe064aad-0220-49c8-9222-d97a20d956ba. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2b6c7-fc04-4a91-a5cb-115bbae06163]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:33 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru
Sep 20 17:08:33 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:33 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:33 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru
Sep 20 17:08:33 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:33 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru" returned: 1 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7991987-47d4-4b4b-afb1-42be508f2fa4__1pikvru' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c6f340-50de-40d5-90ca-4014d5a139e9]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:34 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:34 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:34 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:34 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD
Sep 20 17:08:34 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:34 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] c7991987-47d4-4b4b-afb1-42be508f2fa4 was raw, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:34 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:34 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:34 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7991987-47d4-4b4b-afb1-42be508f2fa4_4sm8gp15devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:08:34 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Converted 0.00 MB image at 0.00 MB/s
Sep 20 17:08:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:34 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1G
Sep 20 17:08:34 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:35 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba 1G" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea2d52-bcba-463b-850b-5f21021e7915]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:35 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:35 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:35 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:35 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:35 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:35 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 1 in 0.359s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Downloaded image c7991987-47d4-4b4b-afb1-42be508f2fa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}])) to volume fe064aad-0220-49c8-9222-d97a20d956ba successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Temporary image c7991987-47d4-4b4b-afb1-42be508f2fa4 for user 694fbd31200c4bebbc2d04da6d873f9a is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Marking volume fe064aad-0220-49c8-9222-d97a20d956ba as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Copying metadata from image c7991987-47d4-4b4b-afb1-42be508f2fa4 to fe064aad-0220-49c8-9222-d97a20d956ba. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:08:35 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Creating volume glance metadata for volume fe064aad-0220-49c8-9222-d97a20d956ba backed by image c7991987-47d4-4b4b-afb1-42be508f2fa4 with: {'image_id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '42f489ca6e6e12fd6359a0a8595508b5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a983a4-cc90-48c1-af7f-dda22ea226d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe064aad-0220-49c8-9222-d97a20d956ba', 'volume_size': 1, 'image_id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7991987-47d4-4b4b-afb1-42be508f2fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f489ca6e6e12fd6359a0a8595508b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f54554b8df545e1b3e256b7b70e2a02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db9691c627d5f3a14e5a00ed497e2684f7c65aff4b0a0d4d8ae4dde1b9446daf31803722146c102f3e8edcb7142aa7a294202d78979d173a28c1b3791d4161d8', 'id': 'c7991987-47d4-4b4b-afb1-42be508f2fa4', 'created_at': datetime.datetime(2026, 9, 20, 15, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 8, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7991987-47d4-4b4b-afb1-42be508f2fa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fc28050>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1e7d25-847b-4579-9d9a-dc83430dfdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:36 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Volume volume-fe064aad-0220-49c8-9222-d97a20d956ba (fe064aad-0220-49c8-9222-d97a20d956ba): created successfully
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1e7d25-847b-4579-9d9a-dc83430dfdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Flow 'volume_create_manager' (fbe28be6-1527-43db-8089-2be9cc4284ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d0caa8db-60f4-44fc-80fd-2167f98953c3 tempest-VolumeImageDependencyTests-53816673 None] Created volume successfully.
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Acquiring lock "cinder-fe064aad-0220-49c8-9222-d97a20d956ba-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "cinder-fe064aad-0220-49c8-9222-d97a20d956ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Acquiring lock "cinder-quobyte-fe064aad-0220-49c8-9222-d97a20d956ba" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "cinder-quobyte-fe064aad-0220-49c8-9222-d97a20d956ba" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159934b-3c85-4671-99fa-ad7ec970cf6a]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:37 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:37 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:37 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 0 in 0.362s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:37 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:37 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:37 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 1 in 0.347s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:08:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:37 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba
Sep 20 17:08:37 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:37 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-fe064aad-0220-49c8-9222-d97a20d956ba" returned: 0 in 0.241s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "cinder-quobyte-fe064aad-0220-49c8-9222-d97a20d956ba" released by "delete_volume" :: held 1.011s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Created reservations ['058b73ef-0591-4131-8455-229ba18eb8fe', 'a2c4e2ac-6710-4ce6-bac5-d8e518eee6a8', '5ac2a5e4-c9d6-4826-a63d-0d5e8b7da381', '5ce761e5-21ff-4eaa-b29b-f51f1c6663bb'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:38 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:38 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:38 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.234s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Deleted volume successfully.
Sep 20 17:08:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a88fd99c-563b-4593-b3c4-784542fbc326 tempest-VolumeImageDependencyTests-53816673 None] Lock "cinder-fe064aad-0220-49c8-9222-d97a20d956ba-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Flow 'volume_create_manager' (bcf0f237-3ec8-4f1b-89d6-5a05e22b54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94416f7b-1a4e-483d-be6e-dfef25a6d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94416f7b-1a4e-483d-be6e-dfef25a6d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7ca9e6-b330-420d-867e-780027018150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f13f54a38142c79821ebda0c41f952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:42Z,use_quota=True,user_id='2a96ddc512c849babc46817bc5ee378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff6b141-d921-4129-81ab-12e8fd0cba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff6b141-d921-4129-81ab-12e8fd0cba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a2a8a-86c4-4576-8427-fbbf25135121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a2a8a-86c4-4576-8427-fbbf25135121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7ca9e6-b330-420d-867e-780027018150', 'volume_name': 'volume-9a7ca9e6-b330-420d-867e-780027018150', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d4eec7-b6c4-4c18-9e2c-5b1d0cc4aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d4eec7-b6c4-4c18-9e2c-5b1d0cc4aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883ce012-e761-4cd9-a45e-6e7e57f72283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:42 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Volume 9a7ca9e6-b330-420d-867e-780027018150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7ca9e6-b330-420d-867e-780027018150', 'volume_size': 1}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7ca9e6-b330-420d-867e-780027018150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f13f54a38142c79821ebda0c41f952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:42Z,use_quota=True,user_id='2a96ddc512c849babc46817bc5ee378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Creating volume 9a7ca9e6-b330-420d-867e-780027018150 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:42 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:42 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 1073741824
Sep 20 17:08:42 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:42 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 1073741824" returned: 0 in 0.412s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:42 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150
Sep 20 17:08:42 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:43 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883ce012-e761-4cd9-a45e-6e7e57f72283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7ca9e6-b330-420d-867e-780027018150', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831d21f4-21f7-4418-b209-f4f6c10439d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Volume volume-9a7ca9e6-b330-420d-867e-780027018150 (9a7ca9e6-b330-420d-867e-780027018150): created successfully
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831d21f4-21f7-4418-b209-f4f6c10439d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Flow 'volume_create_manager' (bcf0f237-3ec8-4f1b-89d6-5a05e22b54b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-77d9ebc8-0dfa-4ad0-86ce-b712c1b0ac80 tempest-CinderUnicodeTest-515010467 None] Created volume successfully.
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Flow 'volume_create_manager' (897df4c9-9339-411a-84c2-4958397f5f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571bfd53-e0bb-4184-a324-eb7a9ee1e3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571bfd53-e0bb-4184-a324-eb7a9ee1e3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2001533137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76776e1-50eb-4e49-a273-cb876822d0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f13f54a38142c79821ebda0c41f952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:44Z,use_quota=True,user_id='2a96ddc512c849babc46817bc5ee378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39614630-9a96-4302-963f-f169d545d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39614630-9a96-4302-963f-f169d545d766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2960cd56-d0aa-4ec4-94fd-ce500ecd02e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2960cd56-d0aa-4ec4-94fd-ce500ecd02e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76776e1-50eb-4e49-a273-cb876822d0c4', 'volume_name': 'volume-c76776e1-50eb-4e49-a273-cb876822d0c4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be6d25-3bc5-4cbb-9712-eaa10a768df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be6d25-3bc5-4cbb-9712-eaa10a768df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0bec6-11db-412f-bfdf-4015fcad8b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Volume c76776e1-50eb-4e49-a273-cb876822d0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76776e1-50eb-4e49-a273-cb876822d0c4', 'volume_size': 1}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2001533137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76776e1-50eb-4e49-a273-cb876822d0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f13f54a38142c79821ebda0c41f952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:44Z,use_quota=True,user_id='2a96ddc512c849babc46817bc5ee378c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Creating volume c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:43 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:43 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 1073741824
Sep 20 17:08:43 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:44 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 1073741824" returned: 0 in 0.438s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:44 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4
Sep 20 17:08:44 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:44 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4" returned: 0 in 0.235s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0bec6-11db-412f-bfdf-4015fcad8b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76776e1-50eb-4e49-a273-cb876822d0c4', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8caf9c3-49cb-409d-b2bd-e8715d58b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:44 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Volume volume-c76776e1-50eb-4e49-a273-cb876822d0c4 (c76776e1-50eb-4e49-a273-cb876822d0c4): created successfully
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8caf9c3-49cb-409d-b2bd-e8715d58b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:44 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Flow 'volume_create_manager' (897df4c9-9339-411a-84c2-4958397f5f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e2ef6c8b-37df-402d-abd0-2cceaec4eb5b tempest-CinderUnicodeTest-515010467 None] Created volume successfully.
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Creating offline snapshot 977f351a-2c2c-4c1a-9423-b1aa5f5b5567 of volume c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b266cf-4425-4e4c-a37e-1de0a9ae9335]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:45 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4
Sep 20 17:08:45 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:45 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:45 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 1G
Sep 20 17:08:45 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:45 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 1G" returned: 0 in 0.405s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76776e1-50eb-4e49-a273-cb876822d0c4 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:45 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76776e1-50eb-4e49-a273-cb876822d0c4 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567
Sep 20 17:08:45 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:46 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76776e1-50eb-4e49-a273-cb876822d0c4 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:46 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 is being set with open permissions: ugo+rw
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:46 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567
Sep 20 17:08:46 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:46 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567" returned: 0 in 0.243s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:46 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info
Sep 20 17:08:46 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:46 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info" returned: 0 in 0.242s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:46 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info is being set with open permissions: ugo+rw
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:46 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info
Sep 20 17:08:46 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:46 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.info" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dc9e86da-4057-478e-8cf8-d6f8af09bd02 tempest-CinderUnicodeTest-515010467 None] Create snapshot completed successfully
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-977f351a-2c2c-4c1a-9423-b1aa5f5b5567-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-977f351a-2c2c-4c1a-9423-b1aa5f5b5567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-quobyte-977f351a-2c2c-4c1a-9423-b1aa5f5b5567" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-977f351a-2c2c-4c1a-9423-b1aa5f5b5567" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Deleting offline snapshot 977f351a-2c2c-4c1a-9423-b1aa5f5b5567 of volume c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] snapshot_file for this snap is: volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[00149256-e164-4b32-bea7-ae352613459d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:47 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567
Sep 20 17:08:47 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:47 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76776e1-50eb-4e49-a273-cb876822d0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7693a6-170c-4170-8c14-ffa7421aef6f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:47 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4
Sep 20 17:08:47 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:48 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4" returned: 0 in 0.356s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:48 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567
Sep 20 17:08:48 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:48 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:48 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567
Sep 20 17:08:48 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:48 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4.977f351a-2c2c-4c1a-9423-b1aa5f5b5567" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-977f351a-2c2c-4c1a-9423-b1aa5f5b5567" released by "_delete_snapshot" :: held 1.418s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" released by "delete_snapshot" :: held 1.439s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Created reservations ['9c12ac83-b966-490d-b8ca-ea410644467e', '6b19d3a4-0772-4706-a0e4-11e08db20abe', 'fc592d9f-c841-4e0a-832e-368693d02adb', 'a628cdcd-a7bd-4ea2-b025-b9d6be6d8b51'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Delete snapshot completed successfully.
Sep 20 17:08:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-be660f52-1c50-42bd-9d45-6c5254118341 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-977f351a-2c2c-4c1a-9423-b1aa5f5b5567-delete_snapshot" released by "delete_snapshot" :: held 1.576s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-c76776e1-50eb-4e49-a273-cb876822d0c4-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-c76776e1-50eb-4e49-a273-cb876822d0c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce71b4-a035-428e-a9cf-4248769f4920]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:49 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4
Sep 20 17:08:49 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:49 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:49 devstack sudo[105866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4
Sep 20 17:08:49 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:50 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-c76776e1-50eb-4e49-a273-cb876822d0c4" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-c76776e1-50eb-4e49-a273-cb876822d0c4" released by "delete_volume" :: held 0.681s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Created reservations ['ae1fee66-76d3-457f-8eb8-7bbd49eb8690', 'e2516e09-bbea-4a24-a508-3e4716f871f9', '8d2f08c4-3ecd-4770-bd8c-652bc2cd413f', '44bb11f8-7cf7-4ba3-a452-3d32e3636fe9'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:50 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:50 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:50 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.244s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Deleted volume successfully.
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-80317733-8498-400f-89ae-5b18fee64183 tempest-CinderUnicodeTest-515010467 None] Lock "cinder-c76776e1-50eb-4e49-a273-cb876822d0c4-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-9a7ca9e6-b330-420d-867e-780027018150-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "cinder-9a7ca9e6-b330-420d-867e-780027018150-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Acquiring lock "cinder-quobyte-9a7ca9e6-b330-420d-867e-780027018150" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-9a7ca9e6-b330-420d-867e-780027018150" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[265217f7-fe34-401b-babd-c5d3401b4592]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:50 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150
Sep 20 17:08:50 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:50 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150" returned: 0 in 0.343s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:51 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150
Sep 20 17:08:51 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:51 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9a7ca9e6-b330-420d-867e-780027018150" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "cinder-quobyte-9a7ca9e6-b330-420d-867e-780027018150" released by "delete_volume" :: held 0.642s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Created reservations ['e423adba-6d4b-4148-a78e-468c403ff5a5', '7abb9952-1387-4d6e-b576-e0318f9e6a0d', 'd9ec914d-a878-4806-ac73-0d7dc75bd94d', '82505119-ffca-4133-9c2d-3a488fc8b60e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:51 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:51 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:51 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.252s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:51 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Deleted volume successfully.
Sep 20 17:08:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7ebe6b7c-dd84-45d2-ac83-b7b91c77468b tempest-CinderUnicodeTest-515010467 None] Lock "cinder-9a7ca9e6-b330-420d-867e-780027018150-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=124,cinder:SELECT=113,cinder:INSERT=35,cinder:DELETE=10 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=90,cinder:UPDATE=148,cinder:INSERT=38,cinder:DELETE=14 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (591d58b9-72f7-4eac-ab7f-ddfc2612732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68dd753-0f55-445c-ae3c-6432c8fb661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68dd753-0f55-445c-ae3c-6432c8fb661b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399624195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794925d9-9ee9-45fe-963e-1be5667ec507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:55Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac881d-74fe-40ce-8716-a54712eba4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac881d-74fe-40ce-8716-a54712eba4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344e334-c4be-4f76-baea-e0a192f554a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344e334-c4be-4f76-baea-e0a192f554a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794925d9-9ee9-45fe-963e-1be5667ec507', 'volume_name': 'volume-794925d9-9ee9-45fe-963e-1be5667ec507', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e0df5f-dd4d-4e90-ac34-8323a05fdc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e0df5f-dd4d-4e90-ac34-8323a05fdc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03137e60-b23c-47a9-929b-9d356c9ca8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:55 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Volume 794925d9-9ee9-45fe-963e-1be5667ec507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794925d9-9ee9-45fe-963e-1be5667ec507', 'volume_size': 1}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399624195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794925d9-9ee9-45fe-963e-1be5667ec507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:55Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Creating volume 794925d9-9ee9-45fe-963e-1be5667ec507 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:55 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:55 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 1073741824
Sep 20 17:08:55 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:55 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 1073741824" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:55 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507
Sep 20 17:08:55 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:56 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507" returned: 0 in 0.290s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03137e60-b23c-47a9-929b-9d356c9ca8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794925d9-9ee9-45fe-963e-1be5667ec507', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7c7e08-7c3d-4afa-831e-5b6acbe0191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:56 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Volume volume-794925d9-9ee9-45fe-963e-1be5667ec507 (794925d9-9ee9-45fe-963e-1be5667ec507): created successfully
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7c7e08-7c3d-4afa-831e-5b6acbe0191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (591d58b9-72f7-4eac-ab7f-ddfc2612732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:56 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e0065c5f-c31d-4e2a-b625-fdaccf6d3ee9 tempest-ProjectReaderTests-1631410150 None] Created volume successfully.
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-794925d9-9ee9-45fe-963e-1be5667ec507-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "cinder-794925d9-9ee9-45fe-963e-1be5667ec507-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-quobyte-794925d9-9ee9-45fe-963e-1be5667ec507" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-794925d9-9ee9-45fe-963e-1be5667ec507" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db3dbb-1ce3-4a3e-b242-c92ecfd46cfa]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:56 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507
Sep 20 17:08:56 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:56 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507" returned: 0 in 0.373s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:56 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507
Sep 20 17:08:56 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:57 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-794925d9-9ee9-45fe-963e-1be5667ec507" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-794925d9-9ee9-45fe-963e-1be5667ec507" released by "delete_volume" :: held 0.663s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Created reservations ['ccd47500-fd7d-4f82-80fe-e74688c30cc6', 'b920c824-0249-408b-8119-4a95b5f5b6bf', 'f0ccae92-983b-470e-bb2b-59cbf66eac5f', 'c772b193-e814-4631-ac9c-8ddd7e5def6c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:57 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:57 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:57 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Deleted volume successfully.
Sep 20 17:08:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-246e4c7b-3472-48b1-a9b3-14aeae3b892b tempest-ProjectReaderTests-1631410150 None] Lock "cinder-794925d9-9ee9-45fe-963e-1be5667ec507-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (83ed3901-0510-4e99-a6f4-fd3481c6d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c6bc7-70f9-42ca-bfa4-d8dd45febb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c6bc7-70f9-42ca-bfa4-d8dd45febb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217935790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b9b68f-bbfa-4c7b-b33c-853d247e479d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:58Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9e6758-4f62-4aac-bca0-2fdcf8f05373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9e6758-4f62-4aac-bca0-2fdcf8f05373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6209fb3-607a-4ce2-b408-0c93760c5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6209fb3-607a-4ce2-b408-0c93760c5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b9b68f-bbfa-4c7b-b33c-853d247e479d', 'volume_name': 'volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fc1450-a302-481b-9986-7726befe3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fc1450-a302-481b-9986-7726befe3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde696af-c86b-42f5-a9b6-256d5a06d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Volume b8b9b68f-bbfa-4c7b-b33c-853d247e479d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d', 'volume_size': 1}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217935790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b9b68f-bbfa-4c7b-b33c-853d247e479d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:08:58Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Creating volume b8b9b68f-bbfa-4c7b-b33c-853d247e479d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:08:58 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:58 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d 1073741824
Sep 20 17:08:58 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:58 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:58 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:58 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d 1073741824" returned: 0 in 0.425s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:58 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:08:58 devstack sudo[105950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d
Sep 20 17:08:58 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:58 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde696af-c86b-42f5-a9b6-256d5a06d573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9382d71-4fee-4910-ad33-10fca09031f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:08:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Volume volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d (b8b9b68f-bbfa-4c7b-b33c-853d247e479d): created successfully
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9382d71-4fee-4910-ad33-10fca09031f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:08:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (83ed3901-0510-4e99-a6f4-fd3481c6d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:08:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-af49d446-e43d-479e-ac19-569748c3b3d9 tempest-ProjectReaderTests-1631410150 None] Created volume successfully.
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-b8b9b68f-bbfa-4c7b-b33c-853d247e479d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-b8b9b68f-bbfa-4c7b-b33c-853d247e479d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-quobyte-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b736df2-d082-4009-9125-e485b8b9fa07]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:59 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d
Sep 20 17:08:59 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:59 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" returned: 0 in 0.363s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:59 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d
Sep 20 17:08:59 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:08:59 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" returned: 0 in 0.247s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-b8b9b68f-bbfa-4c7b-b33c-853d247e479d" released by "delete_volume" :: held 0.651s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Created reservations ['319eb4bd-1bad-4cf5-9780-1c8e1247a7f4', '2860788a-1ab9-4b9a-b680-605ba6b083ad', '3e0bfd0f-a2d1-4c95-8e4f-94e6b53e0e32', '269c0129-6160-4ebb-806c-949e862389a1'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:08:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:08:59 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:08:59 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:00 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Deleted volume successfully.
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2633511a-7c8d-446b-a7ad-257756742ed6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-b8b9b68f-bbfa-4c7b-b33c-853d247e479d-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (1c833bdc-ea84-4c71-b7df-464ad4d6b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df502eb1-23b9-4318-a531-26438fcd80eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df502eb1-23b9-4318-a531-26438fcd80eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123801341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:01Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f360e3d-6814-44cb-972a-327a3fec85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f360e3d-6814-44cb-972a-327a3fec85d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0746f17-82b0-4022-9bf1-408b7301d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0746f17-82b0-4022-9bf1-408b7301d100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec', 'volume_name': 'volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd84696a-bb6f-442e-8d7e-df282fc27c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd84696a-bb6f-442e-8d7e-df282fc27c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c280000-41b6-4667-9d10-b96ab5151867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:00 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Volume 3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec', 'volume_size': 1}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123801341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:01Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Creating volume 3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:00 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:00 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec 1073741824
Sep 20 17:09:00 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:01 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec 1073741824" returned: 0 in 0.431s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:01 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec
Sep 20 17:09:01 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:01 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" returned: 0 in 0.263s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c280000-41b6-4667-9d10-b96ab5151867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab411a16-605a-4219-aa3c-b08c0e16a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:01 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Volume volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec (3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec): created successfully
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab411a16-605a-4219-aa3c-b08c0e16a042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (1c833bdc-ea84-4c71-b7df-464ad4d6b63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4b14335c-0f70-49c7-bc16-a8fc51953a40 tempest-ProjectReaderTests-1631410150 None] Created volume successfully.
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "cinder-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-quobyte-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd96906-2c3d-48c9-a128-718040cefcbf]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:01 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec
Sep 20 17:09:01 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:02 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" returned: 0 in 0.350s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:02 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec
Sep 20 17:09:02 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:02 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" returned: 0 in 0.234s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec" released by "delete_volume" :: held 0.631s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Created reservations ['bbdc9fe4-5b2f-44f9-9bd7-f2acb82517a7', 'f33c8ae1-5f8a-4da4-844c-8b00694bff7c', 'efe32d13-da9e-4d69-a7f2-1bb319bd6a30', 'de8cab41-fb48-4b39-9de9-b17d3d2586a2'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:02 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:02 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:02 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Deleted volume successfully.
Sep 20 17:09:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8c990026-47a0-48ac-b5e8-4641b7a3571e tempest-ProjectReaderTests-1631410150 None] Lock "cinder-3a4cf803-c5be-4a5f-8f3e-3bf20ee627ec-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (5524d5cc-6e5f-4f05-8a21-cfda959e6149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48dc52e-4479-4f72-aa9d-2531f27d718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48dc52e-4479-4f72-aa9d-2531f27d718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449225842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c5116f-c824-4c8f-b89d-48646f54c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:03Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a0a242-f5d7-4926-bda6-f0b91975c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a0a242-f5d7-4926-bda6-f0b91975c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02524904-b394-486d-bf4a-0222cb318eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02524904-b394-486d-bf4a-0222cb318eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c5116f-c824-4c8f-b89d-48646f54c547', 'volume_name': 'volume-35c5116f-c824-4c8f-b89d-48646f54c547', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df170437-295e-4448-b132-ec526926e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df170437-295e-4448-b132-ec526926e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369e415b-e387-49c0-abc4-d52dc06fe14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:03 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Volume 35c5116f-c824-4c8f-b89d-48646f54c547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c5116f-c824-4c8f-b89d-48646f54c547', 'volume_size': 1}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449225842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c5116f-c824-4c8f-b89d-48646f54c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895532a9af2045f9a8b91bd6031a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:03Z,use_quota=True,user_id='513d7fbc369d4375ab9690100c79f78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Creating volume 35c5116f-c824-4c8f-b89d-48646f54c547 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:03 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:03 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 1073741824
Sep 20 17:09:03 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:03 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 1073741824" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:03 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547
Sep 20 17:09:03 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:04 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369e415b-e387-49c0-abc4-d52dc06fe14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c5116f-c824-4c8f-b89d-48646f54c547', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d31be7-0936-4987-be9e-893b252d6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:04 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Volume volume-35c5116f-c824-4c8f-b89d-48646f54c547 (35c5116f-c824-4c8f-b89d-48646f54c547): created successfully
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d31be7-0936-4987-be9e-893b252d6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Flow 'volume_create_manager' (5524d5cc-6e5f-4f05-8a21-cfda959e6149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d5c41d26-7801-4932-a690-61c11b5fe3f9 tempest-ProjectReaderTests-1631410150 None] Created volume successfully.
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-35c5116f-c824-4c8f-b89d-48646f54c547-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-35c5116f-c824-4c8f-b89d-48646f54c547-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "cinder-quobyte-35c5116f-c824-4c8f-b89d-48646f54c547" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-35c5116f-c824-4c8f-b89d-48646f54c547" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf924f0-0343-473e-b87e-e01fd4095495]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:04 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547
Sep 20 17:09:04 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:04 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547" returned: 0 in 0.347s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:04 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547
Sep 20 17:09:04 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:05 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-35c5116f-c824-4c8f-b89d-48646f54c547" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-quobyte-35c5116f-c824-4c8f-b89d-48646f54c547" released by "delete_volume" :: held 0.638s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Created reservations ['89879805-2e4e-4c62-9123-2b3c607ff625', 'c9298884-4aa1-49b5-88dc-6e119b7f0138', '60e9ccaa-1323-41df-93de-87503538926c', '01882801-ef27-4c8a-9208-f95fcf52d2c6'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:05 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:05 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:05 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Deleted volume successfully.
Sep 20 17:09:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c33bf720-847f-40b4-952a-f1454a2be3b6 tempest-ProjectReaderTests-1631410150 None] Lock "cinder-35c5116f-c824-4c8f-b89d-48646f54c547-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:15 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=31,cinder:UPDATE=43,cinder:INSERT=12,cinder:DELETE=3 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:09:15 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=24,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=8 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Flow 'volume_create_manager' (acae460b-8aeb-4701-b78b-7900091cf601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b823df-4231-40d6-9f19-039d7c547d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b823df-4231-40d6-9f19-039d7c547d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124094475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb9211b-f169-43ac-a408-26aa5e525d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2d8c53f82645eda754ec55ad1746ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:17Z,use_quota=True,user_id='f986323ec120488a91ebb070da77eb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2141261c-24c0-485f-9683-cb00f16b047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2141261c-24c0-485f-9683-cb00f16b047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbc8078-f85a-4037-82e4-40c01bd7d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbc8078-f85a-4037-82e4-40c01bd7d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb9211b-f169-43ac-a408-26aa5e525d92', 'volume_name': 'volume-bcb9211b-f169-43ac-a408-26aa5e525d92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135d85c-a528-4ae1-9bb4-b50a08550d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135d85c-a528-4ae1-9bb4-b50a08550d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7c7b6-52ad-4845-9d91-c23c764bcab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Volume bcb9211b-f169-43ac-a408-26aa5e525d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb9211b-f169-43ac-a408-26aa5e525d92', 'volume_size': 1}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124094475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb9211b-f169-43ac-a408-26aa5e525d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2d8c53f82645eda754ec55ad1746ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:17Z,use_quota=True,user_id='f986323ec120488a91ebb070da77eb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Creating volume bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:17 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:17 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 1073741824
Sep 20 17:09:17 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (cca20339-0cd8-4150-89e9-cce0e571f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e491ab-3d1c-4e95-a6d0-2f391408160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e491ab-3d1c-4e95-a6d0-2f391408160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271134985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe6ec23-706b-42fc-9ef7-bff40383a1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:17Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815ff04f-af09-4a62-9a62-3bf53c9e30d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815ff04f-af09-4a62-9a62-3bf53c9e30d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa33b48-9d4b-47e7-b733-bb4c6847bc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa33b48-9d4b-47e7-b733-bb4c6847bc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe6ec23-706b-42fc-9ef7-bff40383a1f9', 'volume_name': 'volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0918fa7-cd93-41bc-b249-b88ac9cb6d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0918fa7-cd93-41bc-b249-b88ac9cb6d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf2f27c-bcc3-4e26-b64d-bb3f3903a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Volume 4fe6ec23-706b-42fc-9ef7-bff40383a1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9', 'volume_size': 1}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:17 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 1073741824" returned: 0 in 0.552s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:17 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:17 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (78ceb3a4-f6d9-4e18-bb70-28e84035082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1172783-7c64-4d21-9587-e77136516915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1172783-7c64-4d21-9587-e77136516915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260649817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bd4de6-b8ea-4e37-87d7-cb23f2d1f457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c898b8-e09b-4e7c-b396-10d057718d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c898b8-e09b-4e7c-b396-10d057718d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dabb822-b394-448c-a83d-9c45de8e9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dabb822-b394-448c-a83d-9c45de8e9a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bd4de6-b8ea-4e37-87d7-cb23f2d1f457', 'volume_name': 'volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e861ad-408a-43c1-a5eb-b86e60963ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e861ad-408a-43c1-a5eb-b86e60963ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a043c99c-ea4c-4487-bbf8-5f5e4639ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Volume 47bd4de6-b8ea-4e37-87d7-cb23f2d1f457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457', 'volume_size': 1}
Sep 20 17:09:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (5b559446-83cb-4a53-96c8-e281eda662ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f92652-51e7-46f5-a94e-202df1220b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f92652-51e7-46f5-a94e-202df1220b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519343436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396e9ea2-ecd9-437c-bacf-316193fb2e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c09373b-df21-4a8d-8dad-9790face9cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c09373b-df21-4a8d-8dad-9790face9cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ff378d-010d-4f0d-96f9-b666edcb9047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ff378d-010d-4f0d-96f9-b666edcb9047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396e9ea2-ecd9-437c-bacf-316193fb2e43', 'volume_name': 'volume-396e9ea2-ecd9-437c-bacf-316193fb2e43', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2227dc0-5f27-4516-bd1f-153822b12ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2227dc0-5f27-4516-bd1f-153822b12ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555c75f2-4f1c-410d-916a-e29e00659ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume 396e9ea2-ecd9-437c-bacf-316193fb2e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396e9ea2-ecd9-437c-bacf-316193fb2e43', 'volume_size': 1}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:18 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271134985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe6ec23-706b-42fc-9ef7-bff40383a1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:17Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Creating volume 4fe6ec23-706b-42fc-9ef7-bff40383a1f9 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:18 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7c7b6-52ad-4845-9d91-c23c764bcab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb9211b-f169-43ac-a408-26aa5e525d92', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9546feac-db73-4d3d-98f4-10c980ece712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 1073741824
Sep 20 17:09:18 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Volume volume-bcb9211b-f169-43ac-a408-26aa5e525d92 (bcb9211b-f169-43ac-a408-26aa5e525d92): created successfully
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9546feac-db73-4d3d-98f4-10c980ece712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Flow 'volume_create_manager' (acae460b-8aeb-4701-b78b-7900091cf601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:18 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2a2248ae-cff2-43fb-a0cb-0de2bdfaa02f tempest-VolumeDependencyTests-2038398486 None] Created volume successfully.
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (1e3a7572-6343-479a-a02b-33557238137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d611a-bc39-4135-8229-a58babbd17b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d611a-bc39-4135-8229-a58babbd17b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-660322607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e1dc82-6981-4a70-a415-ec599c8ed55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64dca69-6e18-4298-b7af-e18f19cba1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64dca69-6e18-4298-b7af-e18f19cba1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b3ebf2-aadb-4f66-98b3-e4cecb93e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b3ebf2-aadb-4f66-98b3-e4cecb93e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e1dc82-6981-4a70-a415-ec599c8ed55e', 'volume_name': 'volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97816666-5f5a-4926-acc1-375308ea1653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97816666-5f5a-4926-acc1-375308ea1653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78461c4f-5099-4eaa-91d5-09f59e987092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:18 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Volume a3e1dc82-6981-4a70-a415-ec599c8ed55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e', 'volume_size': 1}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:18 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 1073741824" returned: 0 in 0.624s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:18 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9
Sep 20 17:09:18 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (1cf1f3af-1d9f-417b-9dfb-964941c6f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad8d6c8-68b8-4935-8f4e-d17358ca43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad8d6c8-68b8-4935-8f4e-d17358ca43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273576978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fb2f7a-e8e5-463d-9f6a-83cc3507d620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:19Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b229f1-2364-438a-bcf2-059151e2a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b229f1-2364-438a-bcf2-059151e2a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f13d4b-84ab-4e52-9e24-6de7d7b1495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f13d4b-84ab-4e52-9e24-6de7d7b1495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fb2f7a-e8e5-463d-9f6a-83cc3507d620', 'volume_name': 'volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ba0021-fa20-4525-bd7c-6c393ef30ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ba0021-fa20-4525-bd7c-6c393ef30ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1fd279-a312-44d1-8b0b-4ad347664466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Volume 28fb2f7a-e8e5-463d-9f6a-83cc3507d620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620', 'volume_size': 1}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:19 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260649817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bd4de6-b8ea-4e37-87d7-cb23f2d1f457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Creating volume 47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:19 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf2f27c-bcc3-4e26-b64d-bb3f3903a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc7dfac-3f07-4367-b6fb-bd1d2bf6c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 1073741824
Sep 20 17:09:19 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Volume volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 (4fe6ec23-706b-42fc-9ef7-bff40383a1f9): created successfully
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc7dfac-3f07-4367-b6fb-bd1d2bf6c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (cca20339-0cd8-4150-89e9-cce0e571f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-60582714-6d31-4656-a06d-6a04d40064a1 tempest-CreateVolumesFromImageTest-1989943259 None] Created volume successfully.
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (71a9cd81-a707-42f1-8aa2-28c5fb58d728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b2c4d3-a597-4bbb-9a09-05da23896605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b2c4d3-a597-4bbb-9a09-05da23896605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873487721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee9e0a3-4e4f-4179-880c-70720034a61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:19Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1687eadd-2e22-4567-bb05-939d828ed832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1687eadd-2e22-4567-bb05-939d828ed832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e024ca-967c-4588-b48f-91dd7fbb1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e024ca-967c-4588-b48f-91dd7fbb1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee9e0a3-4e4f-4179-880c-70720034a61a', 'volume_name': 'volume-6ee9e0a3-4e4f-4179-880c-70720034a61a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6a7fee-8273-4dee-8dfe-02075de9ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6a7fee-8273-4dee-8dfe-02075de9ac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5b06e5-42b0-4ad7-bcd3-86369402a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Volume 6ee9e0a3-4e4f-4179-880c-70720034a61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee9e0a3-4e4f-4179-880c-70720034a61a', 'volume_size': 1}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:19 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 1073741824" returned: 0 in 0.566s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:19 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457
Sep 20 17:09:19 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:20 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.952s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519343436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396e9ea2-ecd9-437c-bacf-316193fb2e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume 396e9ea2-ecd9-437c-bacf-316193fb2e43 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:20 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a043c99c-ea4c-4487-bbf8-5f5e4639ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec82fc6-27bb-4477-83da-e2a26b115b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:20 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 1073741824
Sep 20 17:09:20 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Volume volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 (47bd4de6-b8ea-4e37-87d7-cb23f2d1f457): created successfully
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec82fc6-27bb-4477-83da-e2a26b115b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (78ceb3a4-f6d9-4e18-bb70-28e84035082c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-587c5238-9ac1-4b8d-9e8e-55c318f3439f tempest-CreateVolumesFromImageTest-1989943259 None] Created volume successfully.
Sep 20 17:09:20 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 1073741824" returned: 0 in 0.476s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:20 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43
Sep 20 17:09:20 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:20 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-660322607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e1dc82-6981-4a70-a415-ec599c8ed55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:18Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Creating volume a3e1dc82-6981-4a70-a415-ec599c8ed55e {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:20 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:21 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e 1073741824
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555c75f2-4f1c-410d-916a-e29e00659ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396e9ea2-ecd9-437c-bacf-316193fb2e43', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedd2075-6997-4789-b451-b2293833b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 (396e9ea2-ecd9-437c-bacf-316193fb2e43): created successfully
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedd2075-6997-4789-b451-b2293833b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (5b559446-83cb-4a53-96c8-e281eda662ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-07d80fc0-0cc5-4a49-b298-75557f814cce tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:21 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e 1073741824" returned: 0 in 0.489s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Flow 'volume_create_manager' (f89d404b-7bb2-4a28-9f39-329ed8fde8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5211e74-1313-4482-aabf-64e9a82ac507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5211e74-1313-4482-aabf-64e9a82ac507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5de014-a3f8-467d-95ca-85c04f7692da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d636a231a645ea8681f6090b0f1e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:21Z,use_quota=True,user_id='d2f43cdce12243e1a7bc94b519fca35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2ebf3b7-e74d-464d-9cbf-9f385b9619b5),volume_type_id=c2ebf3b7-e74d-464d-9cbf-9f385b9619b5)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d54497-fb66-412b-aab8-29cefabcb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d54497-fb66-412b-aab8-29cefabcb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b979f9a-0ddc-4020-be5c-13fff448ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:21 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e
Sep 20 17:09:21 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b979f9a-0ddc-4020-be5c-13fff448ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b5de014-a3f8-467d-95ca-85c04f7692da', 'volume_name': 'volume-7b5de014-a3f8-467d-95ca-85c04f7692da', 'volume_size': 1, 'image_id': '843bfebc-6428-4673-8216-352b960a48d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ad14f69830b7c745144d4aec345c790', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d636a231a645ea8681f6090b0f1e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a063e63def1bec8c992d7d2a1f233b84d71ffa3e2d596be90a01fcfb51efd353373683bddf6a7e3db1df47d714f7da62ef8573b60b431a28c5a94886655e98d', 'id': '843bfebc-6428-4673-8216-352b960a48d6', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843bfebc-6428-4673-8216-352b960a48d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb92ed0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf781bb-9069-4f47-8de0-4087a66732aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf781bb-9069-4f47-8de0-4087a66732aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c50a3b-d9ce-42cc-86bf-491419427b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Volume 7b5de014-a3f8-467d-95ca-85c04f7692da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b5de014-a3f8-467d-95ca-85c04f7692da', 'volume_size': 1, 'image_id': '843bfebc-6428-4673-8216-352b960a48d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ad14f69830b7c745144d4aec345c790', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d636a231a645ea8681f6090b0f1e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a063e63def1bec8c992d7d2a1f233b84d71ffa3e2d596be90a01fcfb51efd353373683bddf6a7e3db1df47d714f7da62ef8573b60b431a28c5a94886655e98d', 'id': '843bfebc-6428-4673-8216-352b960a48d6', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843bfebc-6428-4673-8216-352b960a48d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb92ed0>}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Trying to clone 7b5de014-a3f8-467d-95ca-85c04f7692da from image 843bfebc-6428-4673-8216-352b960a48d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:09:21 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.669s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273576978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fb2f7a-e8e5-463d-9f6a-83cc3507d620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:19Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Creating volume 28fb2f7a-e8e5-463d-9f6a-83cc3507d620 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:21 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 1073741824
Sep 20 17:09:21 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78461c4f-5099-4eaa-91d5-09f59e987092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04342261-3e33-4ddb-8c6e-3762d08512a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Volume volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e (a3e1dc82-6981-4a70-a415-ec599c8ed55e): created successfully
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04342261-3e33-4ddb-8c6e-3762d08512a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (1e3a7572-6343-479a-a02b-33557238137c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8d05e268-0e5d-4456-a899-89c5943b8911 tempest-CreateVolumesFromImageTest-1989943259 None] Created volume successfully.
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:09:21 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Image download 0.00 MB at 0.00 MB/s
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8df2a9-3a89-4248-9468-54421b028b9d]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:22 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:22 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:22 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 1073741824" returned: 0 in 0.484s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:22 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:22 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620
Sep 20 17:09:22 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:22 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:22 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:22 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" returned: 0 in 0.319s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873487721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee9e0a3-4e4f-4179-880c-70720034a61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bdd3b14db3413da7ff69e2dfd046c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:19Z,use_quota=True,user_id='e1a221b41cb540bc9094a8bf7792102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Creating volume 6ee9e0a3-4e4f-4179-880c-70720034a61a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:22 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:22 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a 1073741824
Sep 20 17:09:22 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1fd279-a312-44d1-8b0b-4ad347664466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adbb9d5-07ac-494e-b593-0d69522f3935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Temporary image 843bfebc-6428-4673-8216-352b960a48d6 is fetched for user d2f43cdce12243e1a7bc94b519fca35b. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:09:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Volume volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 (28fb2f7a-e8e5-463d-9f6a-83cc3507d620): created successfully
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adbb9d5-07ac-494e-b593-0d69522f3935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (1cf1f3af-1d9f-417b-9dfb-964941c6f86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (484c19c9-492a-464d-91d9-66e1c2c1e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea17b6-7533-488a-abeb-870f0201bbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-39602e84-4e67-4034-8693-3dadd4625134 tempest-CreateVolumesFromImageTest-1989943259 None] Created volume successfully.
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea17b6-7533-488a-abeb-870f0201bbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588181124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998d0962-4c13-4285-803a-329b49c56723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:23Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92a944f-179e-4744-a4f0-35f5beff1221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92a944f-179e-4744-a4f0-35f5beff1221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c0ff3e-a997-4527-af4a-5b3d7e6bcc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c0ff3e-a997-4527-af4a-5b3d7e6bcc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998d0962-4c13-4285-803a-329b49c56723', 'volume_name': 'volume-998d0962-4c13-4285-803a-329b49c56723', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffcaad-dec7-402e-9899-d7e5227e1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffcaad-dec7-402e-9899-d7e5227e1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9a36a6-ce11-409b-8c7f-95cfa6f735bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume 998d0962-4c13-4285-803a-329b49c56723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998d0962-4c13-4285-803a-329b49c56723', 'volume_size': 1}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b80c59-24ae-406b-8627-892ea8c516b9]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:23 devstack sudo[106110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:23 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (b1d32455-1063-4714-aa91-000951f62fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca93fed-92f9-4136-8b17-c41e5b08558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca93fed-92f9-4136-8b17-c41e5b08558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919569028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d7fa29-51e1-48fa-8d06-bab3c6f079ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:23Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd07468c-75a5-4f0e-af27-990c1cc983f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd07468c-75a5-4f0e-af27-990c1cc983f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c5e76d-66ec-44b6-8bb9-090608f4f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c5e76d-66ec-44b6-8bb9-090608f4f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d7fa29-51e1-48fa-8d06-bab3c6f079ff', 'volume_name': 'volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a1ed8a-81a9-4e08-92ed-792d617d53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a1ed8a-81a9-4e08-92ed-792d617d53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b50d226-784e-498e-a98b-4e9677690db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume b5d7fa29-51e1-48fa-8d06-bab3c6f079ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff', 'volume_size': 1}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a 1073741824" returned: 0 in 0.593s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:23 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:23 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a
Sep 20 17:09:23 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:23 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:23 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:23 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a" returned: 0 in 0.321s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:23 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (2c4a1bdc-a71a-44b9-8af2-20e23a3b6cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ecc70-b006-4533-9d33-f1cb697a7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Creating offline snapshot f28154e4-eb29-4cdb-a2e0-31d20969cf41 of volume bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5b06e5-42b0-4ad7-bcd3-86369402a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee9e0a3-4e4f-4179-880c-70720034a61a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291ddd00-83bf-43ed-8971-6f7280693ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf320d6-ae02-4966-a5d1-a29f44737b55]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ecc70-b006-4533-9d33-f1cb697a7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581254470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f682cde5-47a9-4a21-9b34-d5501c2f677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f682cde5-47a9-4a21-9b34-d5501c2f677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7e8d70-2469-460e-a9e2-fcd2cc0771cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7e8d70-2469-460e-a9e2-fcd2cc0771cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3', 'volume_name': 'volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2159d868-d7f5-4449-bde2-c6d107b6cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2159d868-d7f5-4449-bde2-c6d107b6cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af9933-5597-4b4e-918d-c637f4b715cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume 41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3', 'volume_size': 1}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:23 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Volume volume-6ee9e0a3-4e4f-4179-880c-70720034a61a (6ee9e0a3-4e4f-4179-880c-70720034a61a): created successfully
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291ddd00-83bf-43ed-8971-6f7280693ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:23 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Flow 'volume_create_manager' (71a9cd81-a707-42f1-8aa2-28c5fb58d728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bd25d042-ca39-41e6-88cf-63241751fdff tempest-CreateVolumesFromImageTest-1989943259 None] Created volume successfully.
Sep 20 17:09:24 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:24 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (0edc161e-9699-48c6-b834-b8b6ab6d419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd59645d-79d0-4687-9a4a-7d1189c30784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd59645d-79d0-4687-9a4a-7d1189c30784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687782164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ed3972-c889-49ce-a1c3-cfa61ae53f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081550d-821c-47a6-86c7-afbdee372eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081550d-821c-47a6-86c7-afbdee372eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fee1e6-7bb9-455e-82cf-8d1bd4d0ca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fee1e6-7bb9-455e-82cf-8d1bd4d0ca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ed3972-c889-49ce-a1c3-cfa61ae53f54', 'volume_name': 'volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ddb7ac-e8f8-433b-ac88-bb71b8d7f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ddb7ac-e8f8-433b-ac88-bb71b8d7f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be01f8-923d-4c0f-8551-456ff17aea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume e4ed3972-c889-49ce-a1c3-cfa61ae53f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54', 'volume_size': 1}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:24 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.448s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:24 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 1G
Sep 20 17:09:24 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (40e8bc7d-6ab5-433b-9d4f-3f0c78013657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83686c9c-750b-4548-aca8-1a7e67ab41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83686c9c-750b-4548-aca8-1a7e67ab41bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208706087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef580c08-0601-4c0b-8ad1-ad1b358fb5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3c1523-e7f7-40a3-9643-2ccad52bb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3c1523-e7f7-40a3-9643-2ccad52bb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7de31f-085f-4dba-bb1e-5f7c69b0c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7de31f-085f-4dba-bb1e-5f7c69b0c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef580c08-0601-4c0b-8ad1-ad1b358fb5d2', 'volume_name': 'volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac23af1-6f6c-4675-9088-bcbffe626b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac23af1-6f6c-4675-9088-bcbffe626b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfa5702-5a26-4336-8b05-c7c7c3bc917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume ef580c08-0601-4c0b-8ad1-ad1b358fb5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2', 'volume_size': 1}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:24 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 1G" returned: 0 in 0.399s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb9211b-f169-43ac-a408-26aa5e525d92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:24 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb9211b-f169-43ac-a408-26aa5e525d92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:24 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb9211b-f169-43ac-a408-26aa5e525d92 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.296s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 is being set with open permissions: ugo+rw
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-6ee9e0a3-4e4f-4179-880c-70720034a61a-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:25 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:25 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-6ee9e0a3-4e4f-4179-880c-70720034a61a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-quobyte-6ee9e0a3-4e4f-4179-880c-70720034a61a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-6ee9e0a3-4e4f-4179-880c-70720034a61a" acquired by "delete_volume" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a359fc-3276-4362-933d-f6c97b691e67]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a
Sep 20 17:09:25 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.258s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info
Sep 20 17:09:25 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a
Sep 20 17:09:25 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info" returned: 0 in 0.276s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info is being set with open permissions: ugo+rw
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info
Sep 20 17:09:25 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ee9e0a3-4e4f-4179-880c-70720034a61a" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-6ee9e0a3-4e4f-4179-880c-70720034a61a" released by "delete_volume" :: held 0.671s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Created reservations ['00803134-5164-41ac-b0ad-fc0c076604dc', 'c88dfcac-464a-4cad-a93b-9c56431a3411', '13ec5eba-5be1-4ded-ade0-ced3071573ff', 'fa2a5eff-8cde-4d07-b826-1ca77db610bc'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:25 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.info" returned: 0 in 0.246s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588181124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998d0962-4c13-4285-803a-329b49c56723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:23Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume 998d0962-4c13-4285-803a-329b49c56723 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:25 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 1073741824
Sep 20 17:09:25 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f26caafc-cdfb-4c9e-b8cb-2f0de2485357 tempest-VolumeDependencyTests-2038398486 None] Create snapshot completed successfully
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:25 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:25 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-28fb2f7a-e8e5-463d-9f6a-83cc3507d620-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:26 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-28fb2f7a-e8e5-463d-9f6a-83cc3507d620-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Deleted volume successfully.
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-766125cd-f582-4ab6-89f9-2342dea78ea2 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-6ee9e0a3-4e4f-4179-880c-70720034a61a-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-quobyte-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a79684-cdb0-4203-acda-7ba2b8ca3a54]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:26 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 1073741824" returned: 0 in 0.498s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:26 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620
Sep 20 17:09:26 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723
Sep 20 17:09:26 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:26 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:26 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723" returned: 0 in 0.263s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919569028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d7fa29-51e1-48fa-8d06-bab3c6f079ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:23Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume b5d7fa29-51e1-48fa-8d06-bab3c6f079ff {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:26 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:26 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" returned: 0 in 0.384s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:26 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff 1073741824
Sep 20 17:09:26 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9a36a6-ce11-409b-8c7f-95cfa6f735bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998d0962-4c13-4285-803a-329b49c56723', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4021cced-635a-4e6a-9d4d-1492ad58e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:26 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620
Sep 20 17:09:26 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:26 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-998d0962-4c13-4285-803a-329b49c56723 (998d0962-4c13-4285-803a-329b49c56723): created successfully
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4021cced-635a-4e6a-9d4d-1492ad58e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (484c19c9-492a-464d-91d9-66e1c2c1e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-da6d50c4-f294-4477-a3a1-82e159835a73 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:26 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" returned: 0 in 0.268s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-28fb2f7a-e8e5-463d-9f6a-83cc3507d620" released by "delete_volume" :: held 0.698s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Created reservations ['49243ddb-12aa-406a-b0e5-e03675cdb2b9', '126d7f24-3461-4b23-8dd7-833ae0c02e67', 'd6fdc4c8-7d64-4479-aee2-292323c05c7e', '16d5112b-0792-4638-9223-9bdf1fe64ae6'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:27 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:27 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:27 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff 1073741824" returned: 0 in 0.511s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:27 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff
Sep 20 17:09:27 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:27 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Deleted volume successfully.
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-a3e1dc82-6981-4a70-a415-ec599c8ed55e-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7cf8b47-cfef-4a21-b67d-e43f2f5d7b57 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-28fb2f7a-e8e5-463d-9f6a-83cc3507d620-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-a3e1dc82-6981-4a70-a415-ec599c8ed55e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-quobyte-a3e1dc82-6981-4a70-a415-ec599c8ed55e" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-a3e1dc82-6981-4a70-a415-ec599c8ed55e" acquired by "delete_volume" :: waited 0.031s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b78bf7-5a04-49c2-be1d-60a5682c1165]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:27 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.764s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5de014-a3f8-467d-95ca-85c04f7692da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d636a231a645ea8681f6090b0f1e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:21Z,use_quota=True,user_id='d2f43cdce12243e1a7bc94b519fca35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2ebf3b7-e74d-464d-9cbf-9f385b9619b5),volume_type_id=c2ebf3b7-e74d-464d-9cbf-9f385b9619b5)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Creating volume 7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:27 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:27 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1073741824
Sep 20 17:09:27 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b50d226-784e-498e-a98b-4e9677690db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4273eea7-1484-44cb-9e19-66b1a5d4e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:27 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e
Sep 20 17:09:27 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff (b5d7fa29-51e1-48fa-8d06-bab3c6f079ff): created successfully
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4273eea7-1484-44cb-9e19-66b1a5d4e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (b1d32455-1063-4714-aa91-000951f62fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Flow 'volume_create_manager' (5950429f-670d-4725-b543-4edce0e7129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a3b2d-71ef-4893-8407-a85754bc08c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a3b2d-71ef-4893-8407-a85754bc08c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1765744677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76601a3-216a-4318-b0d8-16388b46e053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2d8c53f82645eda754ec55ad1746ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f28154e4-eb29-4cdb-a2e0-31d20969cf41,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:28Z,use_quota=True,user_id='f986323ec120488a91ebb070da77eb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474e503-9e86-47f0-aeb1-2baae32644d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474e503-9e86-47f0-aeb1-2baae32644d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59752d49-808e-4e17-a1d2-1575222c2afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59752d49-808e-4e17-a1d2-1575222c2afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b76601a3-216a-4318-b0d8-16388b46e053', 'volume_name': 'volume-b76601a3-216a-4318-b0d8-16388b46e053', 'volume_size': 1, 'snapshot_id': 'f28154e4-eb29-4cdb-a2e0-31d20969cf41'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fa372c-563b-4014-bc05-3e9144e2a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fa372c-563b-4014-bc05-3e9144e2a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a466d68-e2de-4d29-ada4-8ef2303795ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Volume b76601a3-216a-4318-b0d8-16388b46e053: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b76601a3-216a-4318-b0d8-16388b46e053', 'volume_size': 1, 'snapshot_id': 'f28154e4-eb29-4cdb-a2e0-31d20969cf41'}
Sep 20 17:09:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-56344226-0f89-46a1-af4a-7f27a70c4a34 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:28 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e" returned: 0 in 0.408s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e
Sep 20 17:09:28 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:28 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1073741824" returned: 0 in 0.466s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:28 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:28 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a3e1dc82-6981-4a70-a415-ec599c8ed55e" returned: 0 in 0.263s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-a3e1dc82-6981-4a70-a415-ec599c8ed55e" released by "delete_volume" :: held 0.749s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Created reservations ['132ea199-8015-4fe7-8f36-e31e57159efe', 'd713ba82-4d48-44c5-9302-ea854d4ee502', '7e06b95c-2d86-4640-bafd-dfae82c371cc', 'd3496e4c-3b6c-4c57-9aab-d986b5267f84'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:28 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581254470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume 41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:28 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:28 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:28 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 1073741824
Sep 20 17:09:28 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Attempting download of 843bfebc-6428-4673-8216-352b960a48d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}])) to volume 7b5de014-a3f8-467d-95ca-85c04f7692da. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[36624ded-3cd8-4943-84cd-e34413196a9c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:28 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4
Sep 20 17:09:28 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-quobyte-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:28 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f5df6-b102-4080-b27d-b19acb0eb92e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Deleted volume successfully.
Sep 20 17:09:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c0f3b4c6-456e-4063-bdd9-094128cf18c9 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-a3e1dc82-6981-4a70-a415-ec599c8ed55e-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:28 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457
Sep 20 17:09:28 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4" returned: 0 in 0.461s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 1073741824" returned: 0 in 0.593s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3
Sep 20 17:09:29 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4
Sep 20 17:09:29 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457
Sep 20 17:09:29 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.132s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687782164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ed3972-c889-49ce-a1c3-cfa61ae53f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume e4ed3972-c889-49ce-a1c3-cfa61ae53f54 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:29 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4" returned: 1 in 0.356s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_843bfebc-6428-4673-8216-352b960a48d6_xmuag9y4' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0230fe61-1354-4eab-b1d4-c77892745aa6]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 1073741824
Sep 20 17:09:29 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af9933-5597-4b4e-918d-c637f4b715cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e58355-4d29-4ddf-a854-e2cfa71590b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:29 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 (41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3): created successfully
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e58355-4d29-4ddf-a854-e2cfa71590b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (2c4a1bdc-a71a-44b9-8af2-20e23a3b6cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:29 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-82c635b2-38f0-4dce-ad37-d8daaed9284b tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:29 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:29 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457" released by "delete_volume" :: held 0.748s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Created reservations ['4aae86a5-f7bd-4020-9173-30029be715ab', 'abe3b99d-a14e-4875-bb6e-2f34bea44bc2', 'fd0828e4-52c1-4a36-873b-98f406079e31', 'ee8f6f3d-2bae-40d1-97dc-89e9f5aeaf75'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:29 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-4fe6ec23-706b-42fc-9ef7-bff40383a1f9-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-4fe6ec23-706b-42fc-9ef7-bff40383a1f9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:29 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD
Sep 20 17:09:29 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:29 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 1073741824" returned: 0 in 0.594s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "cinder-quobyte-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Deleted volume successfully.
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" acquired by "delete_volume" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd3990-033d-4e0a-88ea-711825e7ca14]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54
Sep 20 17:09:30 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9a335208-db1b-4d46-b60d-9becaf0bb255 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-47bd4de6-b8ea-4e37-87d7-cb23f2d1f457-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:30 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9
Sep 20 17:09:30 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] 843bfebc-6428-4673-8216-352b960a48d6 was raw, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:30 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.769s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208706087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef580c08-0601-4c0b-8ad1-ad1b358fb5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682ad37992ff4310a1080e6dd32de413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:24Z,use_quota=True,user_id='21b4d4dddae44d09a10cd5879ae5dbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Creating volume ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:30 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be01f8-923d-4c0f-8551-456ff17aea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:30 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 1073741824
Sep 20 17:09:30 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62b787-d954-4798-9ec4-c2d301b4493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:30 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 (e4ed3972-c889-49ce-a1c3-cfa61ae53f54): created successfully
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62b787-d954-4798-9ec4-c2d301b4493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (0edc161e-9699-48c6-b834-b8b6ab6d419e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-baa2986d-8a44-4c49-86db-121a736ce1b4 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:30 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9
Sep 20 17:09:30 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 0 in 0.352s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_843bfebc-6428-4673-8216-352b960a48d6_m1cv0cqzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:09:30 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Converted 0.00 MB image at 0.00 MB/s
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1G
Sep 20 17:09:30 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" returned: 0 in 0.308s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-quobyte-4fe6ec23-706b-42fc-9ef7-bff40383a1f9" released by "delete_volume" :: held 0.761s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:30 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 1073741824" returned: 0 in 0.500s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Created reservations ['55b3c4a1-fc62-44e6-9905-c2f05a16befb', 'ae28ee22-9bd2-4663-8212-b6fdf383b8b4', '6b21d878-991a-4e10-86a1-a8dbc95a420f', 'db8a1c47-248e-4d40-b651-8ab53d62af64'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:30 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da 1G" returned: 0 in 0.301s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04265d6-ca43-4d06-8c7c-77b479605d1b]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:30 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2
Sep 20 17:09:30 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:31 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:31 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:31 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:31 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:31 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" returned: 0 in 0.335s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.411s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41-b76601a3-216a-4318-b0d8-16388b46e053" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfa5702-5a26-4336-8b05-c7c7c3bc917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5e5157-1648-4cf0-b37b-622b4cf67d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41-b76601a3-216a-4318-b0d8-16388b46e053" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Creating volume b76601a3-216a-4318-b0d8-16388b46e053 from snapshot f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Volume volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 (ef580c08-0601-4c0b-8ad1-ad1b358fb5d2): created successfully
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5e5157-1648-4cf0-b37b-622b4cf67d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Flow 'volume_create_manager' (40e8bc7d-6ab5-433b-9d4f-3f0c78013657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d2a79938-6dbd-4850-b641-b2da68b95d2c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created volume successfully.
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] snapshot: f28154e4-eb29-4cdb-a2e0-31d20969cf41, volume: b76601a3-216a-4318-b0d8-16388b46e053,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:09:31 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 0 in 0.481s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:31 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.432s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b31b97-6475-4fc4-b3c5-8f3a86767211]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Deleted volume successfully.
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0199824c-c187-41bf-9dc9-c36f843fab46 tempest-CreateVolumesFromImageTest-1989943259 None] Lock "cinder-4fe6ec23-706b-42fc-9ef7-bff40383a1f9-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:31 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:31 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:31 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:31 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:31 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 1 in 0.411s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Downloaded image 843bfebc-6428-4673-8216-352b960a48d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}])) to volume 7b5de014-a3f8-467d-95ca-85c04f7692da successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Temporary image 843bfebc-6428-4673-8216-352b960a48d6 for user d2f43cdce12243e1a7bc94b519fca35b is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Marking volume 7b5de014-a3f8-467d-95ca-85c04f7692da as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Copying metadata from image 843bfebc-6428-4673-8216-352b960a48d6 to 7b5de014-a3f8-467d-95ca-85c04f7692da. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Creating volume glance metadata for volume 7b5de014-a3f8-467d-95ca-85c04f7692da backed by image 843bfebc-6428-4673-8216-352b960a48d6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '843bfebc-6428-4673-8216-352b960a48d6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3ad14f69830b7c745144d4aec345c790', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:09:31 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.439s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb9211b-f169-43ac-a408-26aa5e525d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d06cf-7b38-4c77-8669-b94ea28f58fc]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c50a3b-d9ce-42cc-86bf-491419427b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5de014-a3f8-467d-95ca-85c04f7692da', 'volume_size': 1, 'image_id': '843bfebc-6428-4673-8216-352b960a48d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/843bfebc-6428-4673-8216-352b960a48d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ad14f69830b7c745144d4aec345c790', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d636a231a645ea8681f6090b0f1e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a063e63def1bec8c992d7d2a1f233b84d71ffa3e2d596be90a01fcfb51efd353373683bddf6a7e3db1df47d714f7da62ef8573b60b431a28c5a94886655e98d', 'id': '843bfebc-6428-4673-8216-352b960a48d6', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/843bfebc-6428-4673-8216-352b960a48d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019fb92ed0>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd093dd6-6f55-44cc-b110-222a426fae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Volume volume-7b5de014-a3f8-467d-95ca-85c04f7692da (7b5de014-a3f8-467d-95ca-85c04f7692da): created successfully
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd093dd6-6f55-44cc-b110-222a426fae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Flow 'volume_create_manager' (f89d404b-7bb2-4a28-9f39-329ed8fde8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8c1f7813-7a87-4077-9e3f-dbffe54eaeb3 tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Created volume successfully.
Sep 20 17:09:32 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:32 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Acquiring lock "cinder-7b5de014-a3f8-467d-95ca-85c04f7692da-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "cinder-7b5de014-a3f8-467d-95ca-85c04f7692da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Acquiring lock "cinder-quobyte-7b5de014-a3f8-467d-95ca-85c04f7692da" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:32 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.468s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "cinder-quobyte-7b5de014-a3f8-467d-95ca-85c04f7692da" acquired by "delete_volume" :: waited 0.042s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:32 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053
Sep 20 17:09:32 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6e43a-ad2a-4651-87cc-2e24d7fb577f]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" acquired by "delete_volume" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[36798d3f-e22a-4a50-aee7-520321e70ad0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:32 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:32 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:32 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2
Sep 20 17:09:32 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:32 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 0 in 0.489s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:33 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:33 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:33 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2
Sep 20 17:09:33 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:33 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" returned: 0 in 0.716s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:33 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 1 in 0.929s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2" released by "delete_volume" :: held 1.384s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:33 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da
Sep 20 17:09:33 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['2dc9a6af-f234-46ba-87b2-398080287961', 'be0fe6da-77c3-4c30-92ad-72e122a1ee60', 'fc195cd8-3100-4188-9038-ba52cfc1fd2b', 'f628c901-7608-400f-a02a-29ee69cffc00'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:34 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-7b5de014-a3f8-467d-95ca-85c04f7692da" returned: 0 in 0.409s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:34 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:34 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "cinder-quobyte-7b5de014-a3f8-467d-95ca-85c04f7692da" released by "delete_volume" :: held 1.939s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Created reservations ['90084334-660e-4ca1-8773-d3ab77945293', '38f9a12c-b04a-4b7c-bb88-f622a87133cf', '87c67cec-a68f-49d1-b722-a1936e4c2213', '149be5cc-5dd2-4bac-9e72-bb4354336a31'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:34 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:34 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-e4ed3972-c889-49ce-a1c3-cfa61ae53f54-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-e4ed3972-c889-49ce-a1c3-cfa61ae53f54-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:35 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.841s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" acquired by "delete_volume" :: waited 0.031s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b51f9ebd-48d5-46f8-8fcd-656a09770966 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-ef580c08-0601-4c0b-8ad1-ad1b358fb5d2-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a8f19-a2a8-44c8-87da-6a523f8242e2]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:35 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54
Sep 20 17:09:35 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:35 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.780s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Deleted volume successfully.
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a8bfb68-f25b-4d9b-aa7a-205e07e00fca tempest-VolumeAndVolumeTypeFromImageTest-1671130156 None] Lock "cinder-7b5de014-a3f8-467d-95ca-85c04f7692da-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:35 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" returned: 0 in 0.713s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:35 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54
Sep 20 17:09:35 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (6e3311e6-684e-4f80-b155-d2f6d561162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db351986-7deb-4d5b-8f11-f8809ac88b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db351986-7deb-4d5b-8f11-f8809ac88b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-974320129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a83847-0f99-4489-9736-b9dcf71837d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:36Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9c5305-2d55-4e5e-b9c1-350ebb39b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9c5305-2d55-4e5e-b9c1-350ebb39b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf814b9c-6029-498c-991e-f9cfdcf59aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf814b9c-6029-498c-991e-f9cfdcf59aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a83847-0f99-4489-9736-b9dcf71837d1', 'volume_name': 'volume-96a83847-0f99-4489-9736-b9dcf71837d1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adbe6e7-2b42-422b-9ba2-71db6b26932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adbe6e7-2b42-422b-9ba2-71db6b26932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad566ce-0e87-4b72-b64e-d66e7487af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:36 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume 96a83847-0f99-4489-9736-b9dcf71837d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a83847-0f99-4489-9736-b9dcf71837d1', 'volume_size': 1}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:36 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" returned: 0 in 0.626s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-e4ed3972-c889-49ce-a1c3-cfa61ae53f54" released by "delete_volume" :: held 1.454s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['7114f2f4-cd29-47b2-bf59-90d7732df1fe', 'beeac380-6bfc-4862-bbd4-bd2b4eaf8506', 'cf6c8040-319f-4e6f-a875-316a43c36c1f', '77d8579f-02d0-4c17-a153-5fa6f2354e52'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:36 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:36 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:37 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.401s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-07a375b9-6df0-49d0-93e2-31c273691db7 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-e4ed3972-c889-49ce-a1c3-cfa61ae53f54-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" acquired by "delete_volume" :: waited 0.044s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d7db2-9ea4-4fdc-9870-53afe1deb52d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:37 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3
Sep 20 17:09:37 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:38 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" returned: 0 in 0.710s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:38 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3
Sep 20 17:09:38 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:38 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" returned: 0 in 0.464s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3" released by "delete_volume" :: held 1.304s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['82795242-2dec-473f-8713-26cd3067e643', 'b3ac85af-a235-409b-a343-476153301288', '01f9b2f4-60ab-4762-8a70-39196f8d182d', '8fd892e7-8840-45be-8168-d2f9e0961dba'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:39 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:39 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:39 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-418c65f6-834d-4239-8742-638ddaab532c tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-41a2ccd5-bd54-47f6-9a67-3ecbc7e1d8c3-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" acquired by "delete_volume" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b256f-d60a-4fd7-8160-e21c76f88f73]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:40 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff
Sep 20 17:09:40 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:40 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" returned: 0 in 0.716s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:40 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff
Sep 20 17:09:40 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:41 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053" returned: 0 in 8.912s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:41 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f52298-cb67-47fb-a012-ce483f25884a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff" released by "delete_volume" :: held 1.214s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['a856bb96-b0ef-4834-9445-fffda2a3d44c', 'ca095427-9ba5-4ccc-96af-090b6629a4cc', 'd895048c-2528-4156-9ac6-452faea75dc7', '4bdda2f5-0b01-42c4-9d41-aefcfbb88f08'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:41 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:41 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:41 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:41 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:41 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f24e86fe-b979-406f-a88f-4a92a8f90ea8 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-b5d7fa29-51e1-48fa-8d06-bab3c6f079ff-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:41 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:09:41 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Converted 1024.00 MB image at 114.89 MB/s
Sep 20 17:09:41 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 is being set with open permissions: ugo+rw
Sep 20 17:09:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:41 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053
Sep 20 17:09:41 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:42 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" released by "_copy_volume_from_snapshot" :: held 10.812s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41-b76601a3-216a-4318-b0d8-16388b46e053" released by "_create_volume_from_snapshot" :: held 10.879s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.922s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.848s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-974320129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a83847-0f99-4489-9736-b9dcf71837d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:36Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume 96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:42 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:42 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 1073741824
Sep 20 17:09:42 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a466d68-e2de-4d29-ada4-8ef2303795ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76601a3-216a-4318-b0d8-16388b46e053', 'volume_size': 1, 'snapshot_id': 'f28154e4-eb29-4cdb-a2e0-31d20969cf41'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6318b7-4002-4315-976b-ec7cf480d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:42 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Volume volume-b76601a3-216a-4318-b0d8-16388b46e053 (b76601a3-216a-4318-b0d8-16388b46e053): created successfully
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6318b7-4002-4315-976b-ec7cf480d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Flow 'volume_create_manager' (5950429f-670d-4725-b543-4edce0e7129a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d8acf1c1-9f1b-4dd4-9a66-bd040e34498c tempest-VolumeDependencyTests-2038398486 None] Created volume successfully.
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-998d0962-4c13-4285-803a-329b49c56723-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-998d0962-4c13-4285-803a-329b49c56723-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-998d0962-4c13-4285-803a-329b49c56723" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-998d0962-4c13-4285-803a-329b49c56723" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae12b03-6aae-4c31-8e62-9731fe5c9c52]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:42 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723
Sep 20 17:09:42 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:42 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 1073741824" returned: 0 in 0.489s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:42 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1
Sep 20 17:09:42 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:42 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723" returned: 0 in 0.392s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:42 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723
Sep 20 17:09:42 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:42 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1" returned: 0 in 0.274s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad566ce-0e87-4b72-b64e-d66e7487af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a83847-0f99-4489-9736-b9dcf71837d1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:42 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0639b7-eb5d-4442-b8f0-da7cc1845e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:43 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-96a83847-0f99-4489-9736-b9dcf71837d1 (96a83847-0f99-4489-9736-b9dcf71837d1): created successfully
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0639b7-eb5d-4442-b8f0-da7cc1845e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (6e3311e6-684e-4f80-b155-d2f6d561162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2de54cb0-8b20-41d7-bbff-67dc9d3d28a8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:43 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-998d0962-4c13-4285-803a-329b49c56723" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-998d0962-4c13-4285-803a-329b49c56723" released by "delete_volume" :: held 0.710s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['c433a705-8bda-4f5c-8aaa-2a5a78b0b400', '6a70f5a9-0038-4b7b-8018-59f435c5b084', '0d3c0a5a-ec93-4418-966a-f892fbf9c747', '9d663e8b-a9c4-47f7-8d63-6a80481aa011'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:43 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:43 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-f28154e4-eb29-4cdb-a2e0-31d20969cf41-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-f28154e4-eb29-4cdb-a2e0-31d20969cf41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Deleting offline snapshot f28154e4-eb29-4cdb-a2e0-31d20969cf41 of volume bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] snapshot_file for this snap is: volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7f9e3c-4cf3-4890-b591-da77ee3244e7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:43 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-396e9ea2-ecd9-437c-bacf-316193fb2e43-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-396e9ea2-ecd9-437c-bacf-316193fb2e43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:43 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "cinder-quobyte-396e9ea2-ecd9-437c-bacf-316193fb2e43" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:43 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-396e9ea2-ecd9-437c-bacf-316193fb2e43" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280172a-111d-4b30-b3f0-ccd4f01b1135]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e525bc4-475c-4128-af9d-44bd1717619a tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-998d0962-4c13-4285-803a-329b49c56723-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:43 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.496s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb9211b-f169-43ac-a408-26aa5e525d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:09:43 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43
Sep 20 17:09:43 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a84ce-f1f2-43bb-95aa-c6d1d1283132]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating offline snapshot 92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c of volume 96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:09:44 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:44 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a65dd4-f6e4-4130-ba4c-d6b724a322e5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43" returned: 0 in 0.421s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43
Sep 20 17:09:44 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1
Sep 20 17:09:44 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.449s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:44 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-396e9ea2-ecd9-437c-bacf-316193fb2e43" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-quobyte-396e9ea2-ecd9-437c-bacf-316193fb2e43" released by "delete_volume" :: held 0.762s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Created reservations ['65be5903-a5ab-4657-ac13-830d394995d3', '242546b4-2f09-4f2d-bf90-95dc85206053', '25a28e3b-1eb7-4583-b377-9e1ee3e92245', 'd8e45754-6813-44f0-b4bc-f6659c6f7aaf'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:44 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1" returned: 0 in 0.430s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c 1G
Sep 20 17:09:44 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:44 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.474s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:44 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:44 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41
Sep 20 17:09:44 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.324s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:44 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Deleted volume successfully.
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9e17a6ce-d142-4860-a201-0c627d86d268 tempest-CreateVolumesFromSourceVolumeTest-1201738958 None] Lock "cinder-396e9ea2-ecd9-437c-bacf-316193fb2e43-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:45 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c 1G" returned: 0 in 0.575s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a83847-0f99-4489-9736-b9dcf71837d1 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:45 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a83847-0f99-4489-9736-b9dcf71837d1 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c
Sep 20 17:09:45 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:45 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92.f28154e4-eb29-4cdb-a2e0-31d20969cf41" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-f28154e4-eb29-4cdb-a2e0-31d20969cf41" released by "_delete_snapshot" :: held 1.951s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" released by "delete_snapshot" :: held 1.987s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Created reservations ['c533a429-c0cd-4039-b2d3-4804dd9fcc9d', 'a19c68fd-7d71-4b55-a3a5-d1baf32ad161', '1eb51c45-21e2-437e-9ca3-721a71f87361', '4411174d-a4a5-4ce3-8b5b-c7773435d9ca'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Delete snapshot completed successfully.
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-27d38d03-a6cf-47a4-b7c9-44d6e55d12ec tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-f28154e4-eb29-4cdb-a2e0-31d20969cf41-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:45 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a83847-0f99-4489-9736-b9dcf71837d1 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:45 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c is being set with open permissions: ugo+rw
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:45 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c
Sep 20 17:09:45 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:45 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" returned: 0 in 0.270s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:45 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info
Sep 20 17:09:45 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:46 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info is being set with open permissions: ugo+rw
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:46 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info
Sep 20 17:09:46 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:46 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.info" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4efd5af3-e59f-4384-add9-8b8339094caa tempest-CreateVolumesFromSnapshotTest-2135557026 None] Create snapshot completed successfully
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-bcb9211b-f169-43ac-a408-26aa5e525d92-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-bcb9211b-f169-43ac-a408-26aa5e525d92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf69f877-ef16-49ed-85fe-02217bfbd73f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:46 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:46 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:47 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:47 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92
Sep 20 17:09:47 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:47 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-bcb9211b-f169-43ac-a408-26aa5e525d92" returned: 0 in 0.314s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-bcb9211b-f169-43ac-a408-26aa5e525d92" released by "delete_volume" :: held 0.799s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Created reservations ['3928506b-1f69-4c70-82a2-1f3c70b02fce', 'b0ffa8c2-3411-4c8e-925d-6eccdfb4fd0d', 'd9a2ccff-a32b-4f95-8576-a907835ac3c5', '54b6d7db-e32f-4996-a428-19a8a75c61c6'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:47 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:47 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-b76601a3-216a-4318-b0d8-16388b46e053-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-b76601a3-216a-4318-b0d8-16388b46e053-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:47 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.392s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f3a0b-30cd-4cee-bb88-57051284edd3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Deleted volume successfully.
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2b07aa0c-0813-4993-836c-e80bdc086dd8 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-bcb9211b-f169-43ac-a408-26aa5e525d92-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:48 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053
Sep 20 17:09:48 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (1f47313d-309c-457d-9964-60bdfa590334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb00ab8-7726-4009-9f4f-35f722ebfbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb00ab8-7726-4009-9f4f-35f722ebfbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54619802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db02c1-9d54-4074-bc23-f9e8e28a87ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:48Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9679d6da-4f2f-469a-9f99-f3d13adf5845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9679d6da-4f2f-469a-9f99-f3d13adf5845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3380b422-6fb9-4465-82ae-dc65ff279e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3380b422-6fb9-4465-82ae-dc65ff279e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87db02c1-9d54-4074-bc23-f9e8e28a87ac', 'volume_name': 'volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4332b11d-d635-4739-9541-74b94c1a147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4332b11d-d635-4739-9541-74b94c1a147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6819ec-d7c5-4d2e-9808-2f889ca2685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume 87db02c1-9d54-4074-bc23-f9e8e28a87ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac', 'volume_size': 1}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54619802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db02c1-9d54-4074-bc23-f9e8e28a87ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:48Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume 87db02c1-9d54-4074-bc23-f9e8e28a87ac {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:48 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:48 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac 1073741824
Sep 20 17:09:48 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:48 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (3839cb32-f858-42a9-80e8-68581935a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa711e2-54f8-49ff-859a-499065aaecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053" returned: 0 in 0.686s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa711e2-54f8-49ff-859a-499065aaecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693601445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111269ab-3df3-4851-84aa-97589c3049ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:49Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053
Sep 20 17:09:48 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d50e615-8c0f-4789-9d21-49d3342f7cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d50e615-8c0f-4789-9d21-49d3342f7cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5913629-d7fb-436a-ba57-58e94069e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5913629-d7fb-436a-ba57-58e94069e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111269ab-3df3-4851-84aa-97589c3049ce', 'volume_name': 'volume-111269ab-3df3-4851-84aa-97589c3049ce', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105bfc2d-083b-4061-8ede-3099ea8c6681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105bfc2d-083b-4061-8ede-3099ea8c6681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d230a-c8b9-436f-9e60-5c0e37ed8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:48 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume 111269ab-3df3-4851-84aa-97589c3049ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111269ab-3df3-4851-84aa-97589c3049ce', 'volume_size': 1}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:48 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac 1073741824" returned: 0 in 0.662s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:49 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac
Sep 20 17:09:49 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:49 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b76601a3-216a-4318-b0d8-16388b46e053" returned: 0 in 0.435s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-quobyte-b76601a3-216a-4318-b0d8-16388b46e053" released by "delete_volume" :: held 1.216s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Created reservations ['7f8ff0bd-4b01-498c-b69a-b67026aca48c', '7fc4a3e3-9471-40e3-b36c-b4293d4cb424', '6e474e94-b4db-447d-b95a-a26ac34982c9', 'c342dc66-7467-4934-a587-4074b9eccdc8'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:49 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693601445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111269ab-3df3-4851-84aa-97589c3049ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:49Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume 111269ab-3df3-4851-84aa-97589c3049ce {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:49 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:49 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce 1073741824
Sep 20 17:09:49 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6819ec-d7c5-4d2e-9808-2f889ca2685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb00292-9f76-45ed-8f4e-d2569a79b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac (87db02c1-9d54-4074-bc23-f9e8e28a87ac): created successfully
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb00292-9f76-45ed-8f4e-d2569a79b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (1f47313d-309c-457d-9964-60bdfa590334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (03702f85-f1f8-46ec-ae75-bd1e4b3801f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d73511b-c065-458c-8fda-d0e0ca50204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5afd7ccf-5ec2-4c47-b898-0ae2647fa955 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d73511b-c065-458c-8fda-d0e0ca50204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915959302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6aebef-0270-4821-bc61-ca8c2e8329d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:49Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8165a2c-db12-4bc4-90b6-2cf2ba06ab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8165a2c-db12-4bc4-90b6-2cf2ba06ab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b943f2f-57b1-45f0-9334-ca52e13f93fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b943f2f-57b1-45f0-9334-ca52e13f93fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6aebef-0270-4821-bc61-ca8c2e8329d6', 'volume_name': 'volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:49 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf881cec-38ce-4e2d-b182-4d396ca62869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf881cec-38ce-4e2d-b182-4d396ca62869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f66a53c-511d-4c21-a629-7f44199f637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume 3d6aebef-0270-4821-bc61-ca8c2e8329d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6', 'volume_size': 1}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (b66c3edf-4d47-4f6c-9059-dca34acf0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5320c2ea-a9f0-4e99-9549-cfef22baec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5320c2ea-a9f0-4e99-9549-cfef22baec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290591340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c695a0-d41a-43af-8ea9-605f8d8a8df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:50Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98263879-b082-4df2-8b3a-e873cc920883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98263879-b082-4df2-8b3a-e873cc920883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40525a2b-7d25-48c6-a931-c5a160de8310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40525a2b-7d25-48c6-a931-c5a160de8310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c695a0-d41a-43af-8ea9-605f8d8a8df1', 'volume_name': 'volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15407a9-3023-4d52-93b5-311097db0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15407a9-3023-4d52-93b5-311097db0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee74749-6d61-4ab8-8243-e26ad4ae9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume 96c695a0-d41a-43af-8ea9-605f8d8a8df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1', 'volume_size': 1}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.479s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Deleted volume successfully.
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24af76b8-b065-4f63-8793-6cc19b188202 tempest-VolumeDependencyTests-2038398486 None] Lock "cinder-b76601a3-216a-4318-b0d8-16388b46e053-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:50 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce 1073741824" returned: 0 in 0.859s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:50 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce
Sep 20 17:09:50 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (0db18a91-a2c5-40da-9c49-7dafa1271455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349eb549-4581-4751-81b7-b010715b0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349eb549-4581-4751-81b7-b010715b0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1522277076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf92237-768a-44e5-b35b-518ea30f543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:50Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81d9a2b-59e6-4faa-97f5-b4f89fb53685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81d9a2b-59e6-4faa-97f5-b4f89fb53685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84070ca6-6e36-4d7b-a62f-7fe4196ef30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84070ca6-6e36-4d7b-a62f-7fe4196ef30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf92237-768a-44e5-b35b-518ea30f543f', 'volume_name': 'volume-ebf92237-768a-44e5-b35b-518ea30f543f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b39a6e-fd04-4028-b934-0ff5ead7b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b39a6e-fd04-4028-b934-0ff5ead7b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f9f0e-8421-4dc5-8b58-295a04a1d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume ebf92237-768a-44e5-b35b-518ea30f543f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf92237-768a-44e5-b35b-518ea30f543f', 'volume_size': 1}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915959302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6aebef-0270-4821-bc61-ca8c2e8329d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:49Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume 3d6aebef-0270-4821-bc61-ca8c2e8329d6 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:50 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 1073741824
Sep 20 17:09:50 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (586def83-9134-476a-b8a4-cefe72db34b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f88c2f-e886-4264-8b1f-d03a813f01df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d230a-c8b9-436f-9e60-5c0e37ed8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111269ab-3df3-4851-84aa-97589c3049ce', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2592b3-ef8f-4413-b0d1-ed840cb037ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f88c2f-e886-4264-8b1f-d03a813f01df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891262747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4cbce8-a615-45d4-826f-53697aa41b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:51Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca768e-3246-4bc5-b0e2-8b33a888ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca768e-3246-4bc5-b0e2-8b33a888ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e1495-a7aa-4d86-ad1f-c26ff999773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e1495-a7aa-4d86-ad1f-c26ff999773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4cbce8-a615-45d4-826f-53697aa41b2b', 'volume_name': 'volume-8f4cbce8-a615-45d4-826f-53697aa41b2b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bc761a-9410-4ff9-b3aa-97fc2ba2493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bc761a-9410-4ff9-b3aa-97fc2ba2493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0cbfa-89fb-4f15-a0e2-aeef75e31d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Volume 8f4cbce8-a615-45d4-826f-53697aa41b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4cbce8-a615-45d4-826f-53697aa41b2b', 'volume_size': 1}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-111269ab-3df3-4851-84aa-97589c3049ce (111269ab-3df3-4851-84aa-97589c3049ce): created successfully
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2592b3-ef8f-4413-b0d1-ed840cb037ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (3839cb32-f858-42a9-80e8-68581935a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:50 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7c56e92b-eff5-40b6-8e71-ed330a8e9948 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:51 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 1073741824" returned: 0 in 0.564s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:51 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6
Sep 20 17:09:51 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:51 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290591340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c695a0-d41a-43af-8ea9-605f8d8a8df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:50Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume 96c695a0-d41a-43af-8ea9-605f8d8a8df1 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:51 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f66a53c-511d-4c21-a629-7f44199f637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:51 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 1073741824
Sep 20 17:09:51 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7d186b-d6b7-49c5-9dab-bb9b2bd3a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 (3d6aebef-0270-4821-bc61-ca8c2e8329d6): created successfully
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7d186b-d6b7-49c5-9dab-bb9b2bd3a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (03702f85-f1f8-46ec-ae75-bd1e4b3801f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:51 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d31e85d1-01fe-43ba-bb73-e46bb61d51e5 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:52 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 1073741824" returned: 0 in 0.550s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:52 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1
Sep 20 17:09:52 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:52 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1522277076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf92237-768a-44e5-b35b-518ea30f543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba93ec06693644c2ac746d5d4ca8c6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:50Z,use_quota=True,user_id='19f4a355949e43f6a54e6ca36a063250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Creating volume ebf92237-768a-44e5-b35b-518ea30f543f {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:52 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee74749-6d61-4ab8-8243-e26ad4ae9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:52 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f 1073741824
Sep 20 17:09:52 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2f08ab-d0c8-421e-8198-79caa39906c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:52 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 (96c695a0-d41a-43af-8ea9-605f8d8a8df1): created successfully
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2f08ab-d0c8-421e-8198-79caa39906c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:52 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (b66c3edf-4d47-4f6c-9059-dca34acf0c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d3768c7e-aa0a-408a-9ebe-a583535a78f8 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:53 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f 1073741824" returned: 0 in 0.588s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:53 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f
Sep 20 17:09:53 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:53 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.710s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891262747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4cbce8-a615-45d4-826f-53697aa41b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:51Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Creating volume 8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:09:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f9f0e-8421-4dc5-8b58-295a04a1d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf92237-768a-44e5-b35b-518ea30f543f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:53 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b 1073741824
Sep 20 17:09:53 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768ed418-2b47-4f9e-8368-7c1025297ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Volume volume-ebf92237-768a-44e5-b35b-518ea30f543f (ebf92237-768a-44e5-b35b-518ea30f543f): created successfully
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768ed418-2b47-4f9e-8368-7c1025297ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Flow 'volume_create_manager' (0db18a91-a2c5-40da-9c49-7dafa1271455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7fbfa5ce-1e69-4456-8d84-0dfd918d31fc tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created volume successfully.
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-ebf92237-768a-44e5-b35b-518ea30f543f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-ebf92237-768a-44e5-b35b-518ea30f543f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:53 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-ebf92237-768a-44e5-b35b-518ea30f543f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-ebf92237-768a-44e5-b35b-518ea30f543f" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1975e-99de-42f1-ad77-fde17ef8a6b0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:54 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f
Sep 20 17:09:54 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:54 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b 1073741824" returned: 0 in 0.788s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:54 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b
Sep 20 17:09:54 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:54 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f" returned: 0 in 0.563s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:54 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f
Sep 20 17:09:54 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:54 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b" returned: 0 in 0.373s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0cbfa-89fb-4f15-a0e2-aeef75e31d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4cbce8-a615-45d4-826f-53697aa41b2b', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902ed195-8803-47d0-a48b-4ed8a1de6b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:54 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Volume volume-8f4cbce8-a615-45d4-826f-53697aa41b2b (8f4cbce8-a615-45d4-826f-53697aa41b2b): created successfully
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902ed195-8803-47d0-a48b-4ed8a1de6b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (586def83-9134-476a-b8a4-cefe72db34b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:54 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9bc287ec-d347-40d2-a6ae-02898871e74f tempest-ProjectReaderTests-1125936853 None] Created volume successfully.
Sep 20 17:09:54 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ebf92237-768a-44e5-b35b-518ea30f543f" returned: 0 in 0.307s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-ebf92237-768a-44e5-b35b-518ea30f543f" released by "delete_volume" :: held 0.947s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['653ec047-7d21-4c14-a7e9-fa68ebe7efc0', '87ebf7bc-9aa0-45e0-8925-8e9376f631b7', '87f35753-ff59-4d3d-8ab9-20b142c148ce', '1080a6e0-86e8-4f8d-814e-8d1584610aa8'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:55 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:55 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:55 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.290s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:09:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-91262460-0530-4a6b-bd9c-9aa557d1e664 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-ebf92237-768a-44e5-b35b-518ea30f543f-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Creating offline snapshot c215fe1a-9f0c-4604-bf90-dd4eb992da92 of volume 8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6c5ba-7f0e-46b9-ba9d-2ba2f2d96a1c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-96c695a0-d41a-43af-8ea9-605f8d8a8df1-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:56 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b
Sep 20 17:09:56 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-96c695a0-d41a-43af-8ea9-605f8d8a8df1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-96c695a0-d41a-43af-8ea9-605f8d8a8df1" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96c695a0-d41a-43af-8ea9-605f8d8a8df1" acquired by "delete_volume" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867b1d1-9c15-4592-ac1c-02103cd01e7a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:56 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b" returned: 0 in 0.466s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:56 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 1G
Sep 20 17:09:56 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:56 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1
Sep 20 17:09:56 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:57 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1" returned: 0 in 0.546s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:57 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1
Sep 20 17:09:57 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:57 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 1G" returned: 0 in 0.602s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4cbce8-a615-45d4-826f-53697aa41b2b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:57 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4cbce8-a615-45d4-826f-53697aa41b2b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92
Sep 20 17:09:57 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:57 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96c695a0-d41a-43af-8ea9-605f8d8a8df1" returned: 0 in 0.332s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96c695a0-d41a-43af-8ea9-605f8d8a8df1" released by "delete_volume" :: held 0.995s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['be913bf4-c94f-4069-a461-d6ab6ae56fb0', 'ce2bcc01-31b4-456d-898a-7d73ba45c496', '76ecc2e1-4972-4cfe-a097-df56b57d4c8c', 'b09fa52d-4c00-45de-8394-486b568d63fb'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:57 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4cbce8-a615-45d4-826f-53697aa41b2b -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 is being set with open permissions: ugo+rw
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:57 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:57 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:57 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92
Sep 20 17:09:57 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Flow 'volume_create_manager' (a7020ec7-328b-47ac-85c3-9f28a29975dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10c333-106c-4ab4-9976-e9759bd00f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10c333-106c-4ab4-9976-e9759bd00f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d8fbb4-159c-4d65-9207-7fc3bbe8b452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65ab571e4354b74803aa3eb524d9db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:58Z,use_quota=True,user_id='c52f59ac7f374289847136628549f02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57b4c7c-37f1-432d-8d67-735c38ef4659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57b4c7c-37f1-432d-8d67-735c38ef4659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3547d4-91ca-4648-9440-3200073ef3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:57 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.image.glance [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Creating Keystone auth plugin from conf {{(pid=85945) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 20 17:09:57 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92" returned: 0 in 0.310s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.329s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-daffd07c-bbdf-444d-a8f2-6243828b6ae7 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-96c695a0-d41a-43af-8ea9-605f8d8a8df1-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:57 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info
Sep 20 17:09:57 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:58 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:58 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info is being set with open permissions: ugo+rw
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:58 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info
Sep 20 17:09:58 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3547d4-91ca-4648-9440-3200073ef3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06d8fbb4-159c-4d65-9207-7fc3bbe8b452', 'volume_name': 'volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452', 'volume_size': 1, 'image_id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36e5286003f9d66c6076e0e7e4b92ef4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a65ab571e4354b74803aa3eb524d9db9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a02831b6e8c9a1c0ba080421f88a3506e72f33ecc5386b9fc014952501b7b3bbad19432d6a7f2cb09c9053cba79e699b5be4acb247e215a1da1445e935b13d5a', 'id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/722ee873-1f68-4841-b6d0-5c85dd741086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019586d700>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda3a063-f5e0-4188-bf24-76784cd56317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda3a063-f5e0-4188-bf24-76784cd56317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b10c0cb-8298-495f-a256-95b6ee6383d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:09:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452', 'volume_size': 1, 'image_id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36e5286003f9d66c6076e0e7e4b92ef4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a65ab571e4354b74803aa3eb524d9db9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a02831b6e8c9a1c0ba080421f88a3506e72f33ecc5386b9fc014952501b7b3bbad19432d6a7f2cb09c9053cba79e699b5be4acb247e215a1da1445e935b13d5a', 'id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/722ee873-1f68-4841-b6d0-5c85dd741086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019586d700>}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Trying to clone 06d8fbb4-159c-4d65-9207-7fc3bbe8b452 from image 722ee873-1f68-4841-b6d0-5c85dd741086 at location (None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}]). {{(pid=85945) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:58 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:58 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 20 17:09:58 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Image download 0.00 MB at 0.00 MB/s
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[22894c3a-9254-4da1-8b65-d72d2797b02b]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-3d6aebef-0270-4821-bc61-ca8c2e8329d6-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-3d6aebef-0270-4821-bc61-ca8c2e8329d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:58 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.info" returned: 0 in 0.380s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.555s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:58 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:58 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:09:58 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.350s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:09:58 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-eff32fd6-4a2d-4e86-8a8e-c9a4cd693843 tempest-ProjectReaderTests-1125936853 None] Create snapshot completed successfully
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-3d6aebef-0270-4821-bc61-ca8c2e8329d6" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-3d6aebef-0270-4821-bc61-ca8c2e8329d6" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1651c0a-d575-466e-907b-69e9cbac1361]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:58 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6
Sep 20 17:09:58 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:58 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:09:59 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:59 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6
Sep 20 17:09:59 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:59 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Temporary image 722ee873-1f68-4841-b6d0-5c85dd741086 is fetched for user c52f59ac7f374289847136628549f02a. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[36018999-51b3-4b5c-b97c-b9a49d0bd17c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-c215fe1a-9f0c-4604-bf90-dd4eb992da92-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:59 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3d6aebef-0270-4821-bc61-ca8c2e8329d6" returned: 0 in 0.314s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-3d6aebef-0270-4821-bc61-ca8c2e8329d6" released by "delete_volume" :: held 0.791s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:09:59 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:09:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-c215fe1a-9f0c-4604-bf90-dd4eb992da92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-c215fe1a-9f0c-4604-bf90-dd4eb992da92" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-c215fe1a-9f0c-4604-bf90-dd4eb992da92" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Deleting offline snapshot c215fe1a-9f0c-4604-bf90-dd4eb992da92 of volume 8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] snapshot_file for this snap is: volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['b0918cc8-8d46-43b4-a4e6-5bdf277e87cb', 'da11b49b-7eff-4007-a8b9-6b3e9ce89686', '8b29fca9-f23a-436d-b5ba-a2744d4ba31d', '0a77d0d8-44cd-4774-8d11-0268da2c3249'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf689bc-0e32-4090-bba3-3e8414958183]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:09:59 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-111269ab-3df3-4851-84aa-97589c3049ce-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:59 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92
Sep 20 17:09:59 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-111269ab-3df3-4851-84aa-97589c3049ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:09:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-111269ab-3df3-4851-84aa-97589c3049ce" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:09:59 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-111269ab-3df3-4851-84aa-97589c3049ce" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb683859-7bcd-4db4-b676-c4eb2b3dc0e8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:10:00 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:00 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:10:00 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-210b8b63-edfe-4813-97f6-ce2d8d4a0f81 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-3d6aebef-0270-4821-bc61-ca8c2e8329d6-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:00 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce
Sep 20 17:10:00 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92" returned: 0 in 0.553s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f4cbce8-a615-45d4-826f-53697aa41b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6914d0-5d7b-42af-a42e-ccab67fc337f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b
Sep 20 17:10:00 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d8fbb4-159c-4d65-9207-7fc3bbe8b452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65ab571e4354b74803aa3eb524d9db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:09:58Z,use_quota=True,user_id='c52f59ac7f374289847136628549f02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Creating volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:00 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1073741824
Sep 20 17:10:00 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce" returned: 0 in 0.440s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce
Sep 20 17:10:00 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b" returned: 0 in 0.424s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92
Sep 20 17:10:00 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:00 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-111269ab-3df3-4851-84aa-97589c3049ce" returned: 0 in 0.293s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-111269ab-3df3-4851-84aa-97589c3049ce" released by "delete_volume" :: held 0.817s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['5412b62d-5f24-43f4-b142-43ab1cf3876a', '776ab498-9674-4167-83ea-0455d6edf29d', '4bf5e202-b4dd-46d8-8f8e-ab420eb59a66', 'b4b17300-91c5-4e27-8ad1-aa3932abe3f4'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:00 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1073741824" returned: 0 in 0.602s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:01 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:01 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-87db02c1-9d54-4074-bc23-f9e8e28a87ac-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:01 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-87db02c1-9d54-4074-bc23-f9e8e28a87ac-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:01 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92" returned: 0 in 0.583s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-87db02c1-9d54-4074-bc23-f9e8e28a87ac" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:01 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92
Sep 20 17:10:01 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-87db02c1-9d54-4074-bc23-f9e8e28a87ac" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:01 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbfaae8-cfb7-42d9-a978-5e38861bede3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-074680e5-0de3-4614-a87a-8cfb7b5c4e3c tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-111269ab-3df3-4851-84aa-97589c3049ce-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:01 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Attempting download of 722ee873-1f68-4841-b6d0-5c85dd741086 ((None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}])) to volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 20 17:10:01 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac
Sep 20 17:10:01 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b991015-45ad-47e3-b9df-fe9e664c0bac]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:01 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b.c215fe1a-9f0c-4604-bf90-dd4eb992da92" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-c215fe1a-9f0c-4604-bf90-dd4eb992da92" released by "_delete_snapshot" :: held 2.029s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" released by "delete_snapshot" :: held 2.059s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:01 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x
Sep 20 17:10:01 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Created reservations ['86419be5-b3cb-46ca-8ea2-44cc0fcc6347', 'd19d0d17-932f-4437-99ec-e3fffda4b09c', 'bc8bf168-a3a6-422c-9e80-c4b379e23e1f', '6f21ce46-da22-4489-adbc-d1488733a893'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:01 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Delete snapshot completed successfully.
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-f0b34bd1-b707-4993-90da-27a539598fa4 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-c215fe1a-9f0c-4604-bf90-dd4eb992da92-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:01 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac" returned: 0 in 0.478s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:01 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac
Sep 20 17:10:01 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:01 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x" returned: 0 in 0.434s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:02 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x
Sep 20 17:10:02 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:02 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-87db02c1-9d54-4074-bc23-f9e8e28a87ac" returned: 0 in 0.315s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-87db02c1-9d54-4074-bc23-f9e8e28a87ac" released by "delete_volume" :: held 0.859s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['a0c58c1a-d2df-4546-9e86-26f4fa7dbc03', '2ca196b4-d480-4766-a3ac-0de17e7f950f', 'b5647d44-44c5-46c0-ae75-ca798744cf2c', 'd8863fab-cfbb-4f0c-b15b-43dd31628bd7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:02 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:02 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:02 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x" returned: 1 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_722ee873-1f68-4841-b6d0-5c85dd741086_uiwhlt8x' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60c6401-a528-4a6f-be9f-6a57ce6cd017]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleting offline snapshot 92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c of volume 96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] snapshot_file for this snap is: volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[77332254-d592-4fc9-a884-23e9278df901]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:02 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:10:02 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:02 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.334s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1269c511-3ec7-4e13-ab25-bba4f70f81a4 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-87db02c1-9d54-4074-bc23-f9e8e28a87ac-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-8f4cbce8-a615-45d4-826f-53697aa41b2b-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:02 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c
Sep 20 17:10:02 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "cinder-8f4cbce8-a615-45d4-826f-53697aa41b2b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f7de1-f3b4-4ce9-9b01-7157fc27861b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:02 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b
Sep 20 17:10:03 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD
Sep 20 17:10:03 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" returned: 0 in 0.546s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a83847-0f99-4489-9736-b9dcf71837d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2452b124-a8b7-460a-b847-cdded0ea6c54]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1
Sep 20 17:10:03 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b" returned: 0 in 0.452s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] 722ee873-1f68-4841-b6d0-5c85dd741086 was raw, converting to raw {{(pid=85945) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b
Sep 20 17:10:03 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:03 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1" returned: 0 in 0.437s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c
Sep 20 17:10:03 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8f4cbce8-a615-45d4-826f-53697aa41b2b" returned: 0 in 0.301s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-8f4cbce8-a615-45d4-826f-53697aa41b2b" released by "delete_volume" :: held 0.829s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Created reservations ['94c69e43-eeaa-4415-b2b4-1d5d50e20646', '41cfb1ce-1709-4974-bf9c-8b0a95c68a53', '96fa70a4-964e-40f4-8b83-be0ab8695e7a', 'e2f06dc6-a2b2-4e31-a76c-97332159354b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:03 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:03 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 0 in 0.541s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_722ee873-1f68-4841-b6d0-5c85dd741086_cfzco19fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:10:03 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Converted 0.00 MB image at 0.00 MB/s
Sep 20 17:10:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:03 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1G
Sep 20 17:10:03 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:04 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Deleted volume successfully.
Sep 20 17:10:04 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" returned: 0 in 0.569s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b12627ad-8443-4318-8aac-c148faed4aae tempest-ProjectReaderTests-1125936853 None] Lock "cinder-8f4cbce8-a615-45d4-826f-53697aa41b2b-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:04 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c
Sep 20 17:10:04 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:04 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 1G" returned: 0 in 0.388s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a51cae-3311-486e-8142-eb84c39e4a3f]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:04 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:04 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:04 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1.92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" returned: 0 in 0.369s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c" released by "_delete_snapshot" :: held 2.113s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" released by "delete_snapshot" :: held 2.143s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (9919c668-4228-46bf-9fae-34b82a586c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86938e1c-25f3-4fc2-899d-8a3601d1513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86938e1c-25f3-4fc2-899d-8a3601d1513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510494905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a2d9a7-5066-42b3-87a0-018f9b529e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:05Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a21b927-54c1-4ea9-9e49-87c430aeeaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a21b927-54c1-4ea9-9e49-87c430aeeaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d6d6d3-68a3-46f8-8a5c-7019291b54e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d6d6d3-68a3-46f8-8a5c-7019291b54e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a2d9a7-5066-42b3-87a0-018f9b529e62', 'volume_name': 'volume-24a2d9a7-5066-42b3-87a0-018f9b529e62', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36729d0-e7ac-4247-80cb-e09148c0069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36729d0-e7ac-4247-80cb-e09148c0069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af59821-c6bb-48a4-a34e-04f0852684d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:04 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Volume 24a2d9a7-5066-42b3-87a0-018f9b529e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a2d9a7-5066-42b3-87a0-018f9b529e62', 'volume_size': 1}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510494905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a2d9a7-5066-42b3-87a0-018f9b529e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:05Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Creating volume 24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:04 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:04 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 0 in 0.448s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:04 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 1073741824
Sep 20 17:10:04 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['10c77e73-6768-4d74-96f2-b0cba447a611', 'b3727ca9-4eb9-434c-8c0b-abce8503fb69', 'a1f98073-da52-497f-9bde-44c1474bf0d5', '3470ede7-4e1c-497e-bfcb-2a1b354a97aa'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:04 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Delete snapshot completed successfully.
Sep 20 17:10:04 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c1fe0e5b-f139-4ff5-9a75-4b6180bf59eb tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-92c0e8a2-4ebc-41b8-bfe2-f2abcc1a1a5c-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:04 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:04 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:05 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 1 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Downloaded image 722ee873-1f68-4841-b6d0-5c85dd741086 ((None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}])) to volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452 successfully. {{(pid=85945) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Temporary image 722ee873-1f68-4841-b6d0-5c85dd741086 for user c52f59ac7f374289847136628549f02a is deleted. {{(pid=85945) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.volume_utils [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Marking volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452 as bootable. {{(pid=85945) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Copying metadata from image 722ee873-1f68-4841-b6d0-5c85dd741086 to 06d8fbb4-159c-4d65-9207-7fc3bbe8b452. {{(pid=85945) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Creating volume glance metadata for volume 06d8fbb4-159c-4d65-9207-7fc3bbe8b452 backed by image 722ee873-1f68-4841-b6d0-5c85dd741086 with: {'image_id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '36e5286003f9d66c6076e0e7e4b92ef4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85945) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 20 17:10:05 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 1073741824" returned: 0 in 0.566s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b10c0cb-8298-495f-a256-95b6ee6383d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452', 'volume_size': 1, 'image_id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/722ee873-1f68-4841-b6d0-5c85dd741086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36e5286003f9d66c6076e0e7e4b92ef4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a65ab571e4354b74803aa3eb524d9db9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a02831b6e8c9a1c0ba080421f88a3506e72f33ecc5386b9fc014952501b7b3bbad19432d6a7f2cb09c9053cba79e699b5be4acb247e215a1da1445e935b13d5a', 'id': '722ee873-1f68-4841-b6d0-5c85dd741086', 'created_at': datetime.datetime(2026, 9, 20, 15, 9, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 20, 15, 9, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/722ee873-1f68-4841-b6d0-5c85dd741086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e019586d700>}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2af9b7-d184-488c-ac9b-c615e9d04ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Volume volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 (06d8fbb4-159c-4d65-9207-7fc3bbe8b452): created successfully
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2af9b7-d184-488c-ac9b-c615e9d04ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Flow 'volume_create_manager' (a7020ec7-328b-47ac-85c3-9f28a29975dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c3d8a665-0659-4396-a050-9a186461f1aa tempest-VolumeImageDependencyTests-1826197660 None] Created volume successfully.
Sep 20 17:10:05 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62
Sep 20 17:10:05 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:05 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62" returned: 0 in 0.253s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af59821-c6bb-48a4-a34e-04f0852684d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a2d9a7-5066-42b3-87a0-018f9b529e62', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ffb2cf-e34b-4279-98a8-d4a1a349a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-96a83847-0f99-4489-9736-b9dcf71837d1-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:05 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Volume volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 (24a2d9a7-5066-42b3-87a0-018f9b529e62): created successfully
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ffb2cf-e34b-4279-98a8-d4a1a349a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (9919c668-4228-46bf-9fae-34b82a586c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-96a83847-0f99-4489-9736-b9dcf71837d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-988d77db-ab76-4af3-8384-e01dc301fd99 tempest-ProjectReaderTests-1125936853 None] Created volume successfully.
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eba0a0a-8b68-40ea-ad30-eaf028f2a251]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:05 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1
Sep 20 17:10:05 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:06 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1" returned: 0 in 0.369s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:06 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1
Sep 20 17:10:06 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:06 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-96a83847-0f99-4489-9736-b9dcf71837d1" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-quobyte-96a83847-0f99-4489-9736-b9dcf71837d1" released by "delete_volume" :: held 0.703s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Created reservations ['32adac91-2320-400f-b649-1f4d6eab92ca', '4a4f8c15-e9aa-4af4-baaf-098e171f6565', '4da602f3-f7f7-4b9f-9d4d-83f8a32edff3', '97f576f9-9332-4771-85f6-1686cb69c53d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Acquiring lock "cinder-06d8fbb4-159c-4d65-9207-7fc3bbe8b452-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "cinder-06d8fbb4-159c-4d65-9207-7fc3bbe8b452-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Acquiring lock "cinder-quobyte-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:06 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "cinder-quobyte-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:06 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdcf10-118d-42e4-96c0-2c474c5d3e8c]: (4, 'raw') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Creating offline snapshot 3183aa2c-3552-4f9c-b56a-ce837013ce9a of volume 24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:06 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:06 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60320ab-7fd1-43b5-a18b-88efdbda99e6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:07 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:07 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Deleted volume successfully.
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-b5f3f4ba-1dff-4996-8b1a-770a9d761f54 tempest-CreateVolumesFromSnapshotTest-2135557026 None] Lock "cinder-96a83847-0f99-4489-9736-b9dcf71837d1-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:07 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62
Sep 20 17:10:07 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:07 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 0 in 0.480s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:07 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:07 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:07 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62" returned: 0 in 0.502s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:07 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a 1G
Sep 20 17:10:07 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:07 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 1 in 0.529s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452' failed. Not Retrying. {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 20 17:10:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:07 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452
Sep 20 17:10:07 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:08 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a 1G" returned: 0 in 0.611s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:08 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a
Sep 20 17:10:08 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:08 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" returned: 0 in 0.345s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "cinder-quobyte-06d8fbb4-159c-4d65-9207-7fc3bbe8b452" released by "delete_volume" :: held 1.449s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Created reservations ['43fab4a2-17c1-40bd-a7a9-e269bc9ef055', '0a44c7fa-f28c-42d1-bd6b-7f82d985e7e2', '68ead15b-5f0a-4bf4-9519-56da0046fa3f', 'd937e0fe-f6e9-4e60-a904-50ae8c512d8a'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:08 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:08 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:08 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a" returned: 0 in 0.410s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:08 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a is being set with open permissions: ugo+rw
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:08 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a
Sep 20 17:10:08 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:08 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.296s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Deleted volume successfully.
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-3706a3dc-6ea3-4df9-ad34-e8a3b650b45d tempest-VolumeImageDependencyTests-1826197660 None] Lock "cinder-06d8fbb4-159c-4d65-9207-7fc3bbe8b452-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:08 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a" returned: 0 in 0.349s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:08 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info
Sep 20 17:10:08 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:09 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info" returned: 0 in 0.323s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:09 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info is being set with open permissions: ugo+rw
Sep 20 17:10:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:09 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info
Sep 20 17:10:09 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:09 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.info" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.586s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:09 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bbbbfc50-321a-45ab-8d7a-16c111a16fe5 tempest-ProjectReaderTests-1125936853 None] Create snapshot completed successfully
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-3183aa2c-3552-4f9c-b56a-ce837013ce9a-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-3183aa2c-3552-4f9c-b56a-ce837013ce9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-3183aa2c-3552-4f9c-b56a-ce837013ce9a" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-3183aa2c-3552-4f9c-b56a-ce837013ce9a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Deleting offline snapshot 3183aa2c-3552-4f9c-b56a-ce837013ce9a of volume 24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] snapshot_file for this snap is: volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33502f3-51f1-4cf9-9bd3-1f41dba0f376]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:10 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a
Sep 20 17:10:10 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:10 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a" returned: 0 in 0.477s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24a2d9a7-5066-42b3-87a0-018f9b529e62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a4cf16-d299-447b-83bd-8fe7c0ec48b7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:11 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62
Sep 20 17:10:11 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:11 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-404d14db-6a45-4478-8c3f-e27fafc90971 tempest-ProjectAdminTests-1667114712 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.677089691162, 'free_capacity_gb': 1775.677089691162, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85945) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 20 17:10:11 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62" returned: 0 in 0.448s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:11 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a
Sep 20 17:10:11 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:11 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a" returned: 0 in 0.360s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:11 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a
Sep 20 17:10:11 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:12 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62.3183aa2c-3552-4f9c-b56a-ce837013ce9a" returned: 0 in 0.280s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-3183aa2c-3552-4f9c-b56a-ce837013ce9a" released by "_delete_snapshot" :: held 1.728s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" released by "delete_snapshot" :: held 1.770s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Created reservations ['19622dba-8a15-4f5c-9469-3df76d327cfb', '72deef65-6ead-4886-a8a5-cefaee8e6ad1', 'ec69b685-c33b-44fa-85c5-46c815dbe240', 'b98185a3-7d30-45c2-b161-dacdf9cfa89d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Delete snapshot completed successfully.
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-346d5b5c-8fee-4722-b85f-8b04d4d353ce tempest-ProjectReaderTests-1125936853 None] Lock "cinder-3183aa2c-3552-4f9c-b56a-ce837013ce9a-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-24a2d9a7-5066-42b3-87a0-018f9b529e62-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-24a2d9a7-5066-42b3-87a0-018f9b529e62-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (fd94caa3-7c3c-4359-8364-f446b1ad7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348770e-eef1-4366-81d4-a9e499d64292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680d0c8-8962-4214-ba36-f50136890619]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348770e-eef1-4366-81d4-a9e499d64292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62672338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5284590-89df-4fe9-9c60-b642dc0dd258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:13Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9da96e-6c9d-4644-b1bc-a717dcefb9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9da96e-6c9d-4644-b1bc-a717dcefb9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8cf502-eaed-4d53-8597-a8698d1e726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8cf502-eaed-4d53-8597-a8698d1e726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5284590-89df-4fe9-9c60-b642dc0dd258', 'volume_name': 'volume-b5284590-89df-4fe9-9c60-b642dc0dd258', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c04816e-f8a9-45b5-a128-18fc3523110f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c04816e-f8a9-45b5-a128-18fc3523110f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e065810c-71d0-4116-8d84-44eae55d9035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:12 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Volume b5284590-89df-4fe9-9c60-b642dc0dd258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5284590-89df-4fe9-9c60-b642dc0dd258', 'volume_size': 1}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62672338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5284590-89df-4fe9-9c60-b642dc0dd258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:13Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Creating volume b5284590-89df-4fe9-9c60-b642dc0dd258 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:12 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:12 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62
Sep 20 17:10:12 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:12 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 1073741824
Sep 20 17:10:12 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:13 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62" returned: 0 in 0.454s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:13 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62
Sep 20 17:10:13 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:13 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 1073741824" returned: 0 in 0.628s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:13 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:13 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-24a2d9a7-5066-42b3-87a0-018f9b529e62" returned: 0 in 0.422s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:13 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-24a2d9a7-5066-42b3-87a0-018f9b529e62" released by "delete_volume" :: held 0.996s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Created reservations ['8b494f80-6a5f-4a8a-bf71-8e30770fb3da', '83f53804-eeff-4fa0-a391-64813e728140', 'c9e8ddf7-dfec-462f-a23d-cf3c4e9d5579', 'ad37de53-f36b-47d4-839e-cc1502f2b3d5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Flow 'volume_create_manager' (3170546f-37be-48fb-b904-769595b5b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39abcb-bd34-42e9-9ec1-d974c3f736ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39abcb-bd34-42e9-9ec1-d974c3f736ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb9b999-0cd9-4aaf-b678-54fda45ce703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1d259901654c10a0b5fd4a87cf7dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:14Z,use_quota=True,user_id='15be124179e746e3ae76f27f17c5a947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4f244f-15a1-4597-bf93-cdff3bbcd67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:13 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4f244f-15a1-4597-bf93-cdff3bbcd67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35b547e-d531-4c4a-88d5-b12122f7fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35b547e-d531-4c4a-88d5-b12122f7fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb9b999-0cd9-4aaf-b678-54fda45ce703', 'volume_name': 'volume-efb9b999-0cd9-4aaf-b678-54fda45ce703', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da64e5-08ce-40e8-9630-1d9867eebb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da64e5-08ce-40e8-9630-1d9867eebb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9937809-5f68-437e-b64a-b383efe12c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Volume efb9b999-0cd9-4aaf-b678-54fda45ce703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb9b999-0cd9-4aaf-b678-54fda45ce703', 'volume_size': 1}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:13 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb9b999-0cd9-4aaf-b678-54fda45ce703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1d259901654c10a0b5fd4a87cf7dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:14Z,use_quota=True,user_id='15be124179e746e3ae76f27f17c5a947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Creating volume efb9b999-0cd9-4aaf-b678-54fda45ce703 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:13 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e065810c-71d0-4116-8d84-44eae55d9035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5284590-89df-4fe9-9c60-b642dc0dd258', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:13 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebea3b4-d18a-4eb0-8fa8-a33e396489c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:13 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 1073741824
Sep 20 17:10:13 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:13 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Volume volume-b5284590-89df-4fe9-9c60-b642dc0dd258 (b5284590-89df-4fe9-9c60-b642dc0dd258): created successfully
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebea3b4-d18a-4eb0-8fa8-a33e396489c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (fd94caa3-7c3c-4359-8364-f446b1ad7328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d43c1489-c6a3-4f21-8688-708b5a99abf6 tempest-ProjectReaderTests-210649130 None] Created volume successfully.
Sep 20 17:10:14 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.288s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Deleted volume successfully.
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-1e395bbb-d4f2-444b-8082-89ce9b49e8bd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-24a2d9a7-5066-42b3-87a0-018f9b529e62-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:14 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 1073741824" returned: 0 in 0.498s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:14 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703
Sep 20 17:10:14 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:14 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9937809-5f68-437e-b64a-b383efe12c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb9b999-0cd9-4aaf-b678-54fda45ce703', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19278f1-0fe1-4db8-a0af-b4ecb265bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:14 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Volume volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 (efb9b999-0cd9-4aaf-b678-54fda45ce703): created successfully
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19278f1-0fe1-4db8-a0af-b4ecb265bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Flow 'volume_create_manager' (3170546f-37be-48fb-b904-769595b5b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:14 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-345809fd-7017-458c-8fc8-b40d4c434d51 tempest-CinderUnicodeTest-2043624947 None] Created volume successfully.
Sep 20 17:10:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-b5284590-89df-4fe9-9c60-b642dc0dd258-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "cinder-b5284590-89df-4fe9-9c60-b642dc0dd258-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-quobyte-b5284590-89df-4fe9-9c60-b642dc0dd258" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-b5284590-89df-4fe9-9c60-b642dc0dd258" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[68173ddc-4297-467a-8e00-db91e4aa17c8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:15 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258
Sep 20 17:10:15 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=306,cinder:SELECT=214,cinder:INSERT=81,cinder:DELETE=27 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (a27476da-d498-4625-a662-3b9778b32cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6d68c3-d00e-45bc-a8f1-4f5fe6578156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6d68c3-d00e-45bc-a8f1-4f5fe6578156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483981697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:15Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5311a680-d399-4c44-8c0e-ef4e5a131c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5311a680-d399-4c44-8c0e-ef4e5a131c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e945185-d649-48c7-9515-f23ea25b50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e945185-d649-48c7-9515-f23ea25b50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5', 'volume_name': 'volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfd6dce-4647-4c7e-a416-abd635959607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfd6dce-4647-4c7e-a416-abd635959607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c4be06-0f80-4f3b-ac90-31e69f4a7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Volume 6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5', 'volume_size': 1}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483981697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:15Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Creating volume 6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:15 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:15 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 1073741824
Sep 20 17:10:15 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:15 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258" returned: 0 in 0.408s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:15 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258
Sep 20 17:10:15 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:15 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-b5284590-89df-4fe9-9c60-b642dc0dd258" returned: 0 in 0.256s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-b5284590-89df-4fe9-9c60-b642dc0dd258" released by "delete_volume" :: held 0.717s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=210,cinder:UPDATE=275,cinder:DELETE=25,cinder:INSERT=74 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Created reservations ['8879a7d3-0e45-492f-a269-e3adce6e040a', 'ac66df90-9f7d-4f90-a21e-974c6824e569', 'd5d9fd59-9be2-4c2b-b738-239fe2329247', '8a7d823f-0e66-4d76-b9b5-2ff86c067f02'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:15 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 1073741824" returned: 0 in 0.516s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:16 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:16 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:16 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5
Sep 20 17:10:16 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:16 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.283s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Deleted volume successfully.
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-d958020c-7d41-43cd-b369-acc2a646a87d tempest-ProjectReaderTests-210649130 None] Lock "cinder-b5284590-89df-4fe9-9c60-b642dc0dd258-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:16 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" returned: 0 in 0.305s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c4be06-0f80-4f3b-ac90-31e69f4a7425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c67ffcb-950f-4dda-8c5d-7846612294cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (5d8593cd-4fd9-4d36-ba22-d51dbb151854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129e78b0-753c-4ae3-ab67-2401ef2b472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Volume volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 (6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5): created successfully
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c67ffcb-950f-4dda-8c5d-7846612294cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (a27476da-d498-4625-a662-3b9778b32cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129e78b0-753c-4ae3-ab67-2401ef2b472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527552409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaf67f9-b584-484a-ac19-24a98c7da03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:16Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957ffab8-d1e9-42e1-9efb-f0c7f6318f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957ffab8-d1e9-42e1-9efb-f0c7f6318f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a61cf-ddea-4c6b-a723-411e75359172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a61cf-ddea-4c6b-a723-411e75359172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaf67f9-b584-484a-ac19-24a98c7da03f', 'volume_name': 'volume-3eaf67f9-b584-484a-ac19-24a98c7da03f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac19f884-569a-4447-bcda-9a62e48654f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac19f884-569a-4447-bcda-9a62e48654f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ac617-1879-4452-9c53-1b4d6b937068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Volume 3eaf67f9-b584-484a-ac19-24a98c7da03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaf67f9-b584-484a-ac19-24a98c7da03f', 'volume_size': 1}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527552409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaf67f9-b584-484a-ac19-24a98c7da03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:16Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Creating volume 3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:16 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cb8d59b2-3e0d-4d88-83d8-76619cdd5af6 tempest-ProjectReaderTests-1125936853 None] Created volume successfully.
Sep 20 17:10:16 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f 1073741824
Sep 20 17:10:16 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:17 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f 1073741824" returned: 0 in 0.496s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:17 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f
Sep 20 17:10:17 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (6ce4aa8b-59da-4876-b6ef-d3e69bc1aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b026d39-29b1-4108-b1d3-c66656f44f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b026d39-29b1-4108-b1d3-c66656f44f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277166872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da09168-0d5e-4238-a7e1-e5c962c659c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:17Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf41b6-73cc-417b-abff-3e7409000143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf41b6-73cc-417b-abff-3e7409000143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b5467-2d48-4495-b9e9-9c7c3da9b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b5467-2d48-4495-b9e9-9c7c3da9b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da09168-0d5e-4238-a7e1-e5c962c659c2', 'volume_name': 'volume-6da09168-0d5e-4238-a7e1-e5c962c659c2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac372fce-22a5-48eb-98f4-8769b19c28ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac372fce-22a5-48eb-98f4-8769b19c28ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0a81a8-03db-43d7-8874-d71fc86d5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Volume 6da09168-0d5e-4238-a7e1-e5c962c659c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da09168-0d5e-4238-a7e1-e5c962c659c2', 'volume_size': 1}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Flow 'volume_create_manager' (3f3706a0-a1f4-4e2b-a8cb-c3be97bac2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791e3acf-f2c7-4571-8e00-e2a2bbdfdcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791e3acf-f2c7-4571-8e00-e2a2bbdfdcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2138410651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9031e8-59fc-441e-8b4d-5746e79569b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1d259901654c10a0b5fd4a87cf7dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:17Z,use_quota=True,user_id='15be124179e746e3ae76f27f17c5a947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d5b42-cb36-44b4-a50b-145480527bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d5b42-cb36-44b4-a50b-145480527bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b46a6-880a-46e2-9bab-f53923555db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b46a6-880a-46e2-9bab-f53923555db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9031e8-59fc-441e-8b4d-5746e79569b7', 'volume_name': 'volume-9b9031e8-59fc-441e-8b4d-5746e79569b7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eadc71b-e832-46af-8888-b9f82fa5b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eadc71b-e832-46af-8888-b9f82fa5b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd944dca-74d4-44de-ac84-9f3ad5950390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Volume 9b9031e8-59fc-441e-8b4d-5746e79569b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9031e8-59fc-441e-8b4d-5746e79569b7', 'volume_size': 1}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:17 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f" returned: 0 in 0.295s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ac617-1879-4452-9c53-1b4d6b937068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaf67f9-b584-484a-ac19-24a98c7da03f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03d971-8286-43f1-a141-a2fe07578742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Creating offline snapshot 71d5c584-6f69-4d41-baf0-cada151c1320 of volume 6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Volume volume-3eaf67f9-b584-484a-ac19-24a98c7da03f (3eaf67f9-b584-484a-ac19-24a98c7da03f): created successfully
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03d971-8286-43f1-a141-a2fe07578742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (5d8593cd-4fd9-4d36-ba22-d51dbb151854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c0cb0-209a-4247-80f1-82afeef0d535]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-f0744e9a-0810-4bcb-83e9-b5365d0c1080 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:10:17 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5
Sep 20 17:10:17 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:17 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" returned: 0 in 0.356s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:17 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 1G
Sep 20 17:10:17 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:18 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 1G" returned: 0 in 0.385s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:18 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320
Sep 20 17:10:18 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:18 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320" returned: 0 in 0.291s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:18 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 is being set with open permissions: ugo+rw
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:18 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320
Sep 20 17:10:18 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:18 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320" returned: 0 in 0.253s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:18 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info
Sep 20 17:10:18 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:19 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info" returned: 0 in 0.239s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:19 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info is being set with open permissions: ugo+rw
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:19 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info
Sep 20 17:10:19 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:19 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.info" returned: 0 in 0.232s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277166872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da09168-0d5e-4238-a7e1-e5c962c659c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:17Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Creating volume 6da09168-0d5e-4238-a7e1-e5c962c659c2 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:19 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:19 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 1073741824
Sep 20 17:10:19 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e6fc3319-3837-473f-a121-99396f76eabd tempest-ProjectReaderTests-1125936853 None] Create snapshot completed successfully
Sep 20 17:10:19 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 1073741824" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:19 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2
Sep 20 17:10:19 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:19 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2" returned: 0 in 0.229s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] <== create_volume: return (648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2138410651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9031e8-59fc-441e-8b4d-5746e79569b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1d259901654c10a0b5fd4a87cf7dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:17Z,use_quota=True,user_id='15be124179e746e3ae76f27f17c5a947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Creating volume 9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:19 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0a81a8-03db-43d7-8874-d71fc86d5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da09168-0d5e-4238-a7e1-e5c962c659c2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:19 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 1073741824
Sep 20 17:10:19 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b397397-85db-4c08-800a-fd895192e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:19 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Volume volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 (6da09168-0d5e-4238-a7e1-e5c962c659c2): created successfully
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b397397-85db-4c08-800a-fd895192e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:19 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (6ce4aa8b-59da-4876-b6ef-d3e69bc1aa63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:19 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-61585369-9e8e-4c12-9820-5eb3d7acdb81 tempest-ProjectReaderTests-210649130 None] Created volume successfully.
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-71d5c584-6f69-4d41-baf0-cada151c1320-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-71d5c584-6f69-4d41-baf0-cada151c1320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-71d5c584-6f69-4d41-baf0-cada151c1320" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-71d5c584-6f69-4d41-baf0-cada151c1320" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Deleting offline snapshot 71d5c584-6f69-4d41-baf0-cada151c1320 of volume 6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] snapshot_file for this snap is: volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde6dab-eb39-4320-84c1-0da6d8c546c6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:20 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320
Sep 20 17:10:20 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:20 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 1073741824" returned: 0 in 0.463s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:20 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7
Sep 20 17:10:20 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:20 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b679932-5d8b-4321-96d0-94bdb4722899]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:20 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.053s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:20 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5
Sep 20 17:10:20 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 4fd03353-8651-440d-879a-36bd03c186b5 of volume 3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd944dca-74d4-44de-ac84-9f3ad5950390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9031e8-59fc-441e-8b4d-5746e79569b7', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ead73a-dba6-41f3-99e0-1b31880e7371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f6795-254b-4ac6-8dc9-d651e5b5c3bd]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:20 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Volume volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 (9b9031e8-59fc-441e-8b4d-5746e79569b7): created successfully
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ead73a-dba6-41f3-99e0-1b31880e7371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Flow 'volume_create_manager' (3f3706a0-a1f4-4e2b-a8cb-c3be97bac2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6a2ac94e-761b-4d25-9b49-f575ee2e5b30 tempest-CinderUnicodeTest-2043624947 None] Created volume successfully.
Sep 20 17:10:20 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f
Sep 20 17:10:20 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:20 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" returned: 0 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320
Sep 20 17:10:21 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-6da09168-0d5e-4238-a7e1-e5c962c659c2-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "cinder-6da09168-0d5e-4238-a7e1-e5c962c659c2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:21 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f" returned: 0 in 0.432s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-quobyte-6da09168-0d5e-4238-a7e1-e5c962c659c2" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:21 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 1G
Sep 20 17:10:21 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-6da09168-0d5e-4238-a7e1-e5c962c659c2" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb1975-77e6-4445-9cbe-683cdc4ba053]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2
Sep 20 17:10:21 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320" returned: 0 in 0.505s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320
Sep 20 17:10:21 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:21 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 1G" returned: 0 in 0.505s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf67f9-b584-484a-ac19-24a98c7da03f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf67f9-b584-484a-ac19-24a98c7da03f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5
Sep 20 17:10:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2" returned: 0 in 0.465s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:21 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2
Sep 20 17:10:21 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:21 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5.71d5c584-6f69-4d41-baf0-cada151c1320" returned: 0 in 0.325s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-71d5c584-6f69-4d41-baf0-cada151c1320" released by "_delete_snapshot" :: held 1.719s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" released by "delete_snapshot" :: held 1.744s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Created reservations ['3555c1cd-9b9f-4e85-8b01-1ad76dcdc3a5', '8139569f-8cb3-46de-90cc-4a232c19b8d1', '1a565592-98d8-48e8-ba20-45d02f20ba00', 'fc6c7b2f-9c8d-43df-bb55-8bfa90f6f33e'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:21 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6da09168-0d5e-4238-a7e1-e5c962c659c2" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:21 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Delete snapshot completed successfully.
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf67f9-b584-484a-ac19-24a98c7da03f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5" returned: 0 in 0.328s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:21 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 is being set with open permissions: ugo+rw
Sep 20 17:10:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-6da09168-0d5e-4238-a7e1-e5c962c659c2" released by "delete_volume" :: held 0.797s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-807152fb-fdc1-44f2-8c5c-afc598217de5 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-71d5c584-6f69-4d41-baf0-cada151c1320-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:22 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5
Sep 20 17:10:22 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Created reservations ['b1b2ebdb-f17d-491d-b565-9ac6b5817484', '384c7942-0f3e-440d-ba2a-20347afe6b4c', 'aed00de0-e022-4649-a29e-73ff05f4c773', '1a9b3ee5-e399-4c4f-985f-7d7f3c219797'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:22 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "cinder-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" acquired by "delete_volume" :: waited 0.035s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:22 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info
Sep 20 17:10:22 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.339s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Deleted volume successfully.
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716e44e-92ce-46bb-91f1-1c75488fa5b8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5a695de-2b98-4c4d-ae27-c99c7e0da681 tempest-ProjectReaderTests-210649130 None] Lock "cinder-6da09168-0d5e-4238-a7e1-e5c962c659c2-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:22 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5
Sep 20 17:10:22 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:22 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info" returned: 0 in 0.330s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:22 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info is being set with open permissions: ugo+rw
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info
Sep 20 17:10:22 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (f79d05e6-2b88-4d64-a089-54e797bb8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ffb75-c188-4899-b198-f27a3a1d4de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ffb75-c188-4899-b198-f27a3a1d4de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257328983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1b89a3-a35b-4244-9aed-8bef220d1255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:23Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76d2849-9d99-49dc-8cb9-ab61a78fbe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76d2849-9d99-49dc-8cb9-ab61a78fbe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172ca3de-cec6-4227-bf65-6b44f8eeb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:22 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172ca3de-cec6-4227-bf65-6b44f8eeb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1b89a3-a35b-4244-9aed-8bef220d1255', 'volume_name': 'volume-ad1b89a3-a35b-4244-9aed-8bef220d1255', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87ea5c-5431-4e9d-88d1-1be112c3a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87ea5c-5431-4e9d-88d1-1be112c3a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927b5264-3e4d-411d-b823-aaf839024696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:22 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Volume ad1b89a3-a35b-4244-9aed-8bef220d1255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1b89a3-a35b-4244-9aed-8bef220d1255', 'volume_size': 1}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:22 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5
Sep 20 17:10:22 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:23 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.info" returned: 0 in 0.282s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.418s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Creating offline snapshot fbb49837-0aa7-4b48-bfe9-97d5e984f260 of volume 9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0a695661-827b-406a-ae77-60f650eb87d1 tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfafa8b-f29f-40f9-b963-9dc80bbec0be]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:23 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5" released by "delete_volume" :: held 0.764s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:23 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7
Sep 20 17:10:23 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Created reservations ['7dc141e7-4cde-4dc8-84da-f4c8d3ad6793', 'e857da40-cf96-4ede-8cf5-b88632f9f342', '201f342e-aace-4405-9e27-a2348e1ac1c8', '3aad6c9e-5d51-4b6b-aef2-b171bf557139'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:23 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:23 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:23 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:23 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 1G
Sep 20 17:10:23 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:23 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:23 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Deleted volume successfully.
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-88212ea9-1977-4e14-8020-c8e24baf279c tempest-ProjectReaderTests-1125936853 None] Lock "cinder-6ed8889c-8ab5-4904-a0db-5a1b57b1f0a5-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-4fd03353-8651-440d-879a-36bd03c186b5-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-4fd03353-8651-440d-879a-36bd03c186b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-4fd03353-8651-440d-879a-36bd03c186b5" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-4fd03353-8651-440d-879a-36bd03c186b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 4fd03353-8651-440d-879a-36bd03c186b5 of volume 3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:23 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:23 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (e41c9c24-cdfc-4b9f-82d7-466ccd220e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f7fe22-442e-4b3a-b45d-b3c8b202eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[90109cf5-db2d-4c5f-983c-9b0071d76b08]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 1G" returned: 0 in 0.560s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260
Sep 20 17:10:24 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f7fe22-442e-4b3a-b45d-b3c8b202eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364270601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c4c20-ee91-4576-b435-ea85164691ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:24Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56543adb-2ff5-4f81-a023-ea66b05d6993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56543adb-2ff5-4f81-a023-ea66b05d6993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0fdb76-9600-4d68-a8ae-d74299684e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0fdb76-9600-4d68-a8ae-d74299684e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254c4c20-ee91-4576-b435-ea85164691ba', 'volume_name': 'volume-254c4c20-ee91-4576-b435-ea85164691ba', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7ef27c-b539-4486-8dbd-491422f85ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7ef27c-b539-4486-8dbd-491422f85ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4a28f-4642-4407-aac3-4d8886bb72b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:24 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Volume 254c4c20-ee91-4576-b435-ea85164691ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254c4c20-ee91-4576-b435-ea85164691ba', 'volume_size': 1}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:24 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5
Sep 20 17:10:24 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 is being set with open permissions: ugo+rw
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260
Sep 20 17:10:24 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eaf67f9-b584-484a-ac19-24a98c7da03f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8094e-e00f-44e7-8b15-a8e883f6ae44]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f
Sep 20 17:10:24 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260" returned: 0 in 0.249s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info
Sep 20 17:10:24 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5
Sep 20 17:10:24 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:24 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:24 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info is being set with open permissions: ugo+rw
Sep 20 17:10:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:24 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info
Sep 20 17:10:24 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:25 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.info" returned: 0 in 0.255s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257328983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1b89a3-a35b-4244-9aed-8bef220d1255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:23Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Creating volume ad1b89a3-a35b-4244-9aed-8bef220d1255 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:25 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:25 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5" returned: 0 in 0.351s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:25 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 1073741824
Sep 20 17:10:25 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:25 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5
Sep 20 17:10:25 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-44ddfb04-1500-4d7d-824b-4ead0bbb2468 tempest-CinderUnicodeTest-2043624947 None] Create snapshot completed successfully
Sep 20 17:10:25 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f.4fd03353-8651-440d-879a-36bd03c186b5" returned: 0 in 0.267s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-4fd03353-8651-440d-879a-36bd03c186b5" released by "_delete_snapshot" :: held 1.545s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" released by "delete_snapshot" :: held 1.571s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Created reservations ['236a9340-eb07-4429-b25a-d366a05d8cfe', '39539f03-68da-43db-9fb0-0bda470c6ed5', '37ae7f97-48fd-4608-a9fe-097c19fe36ec', '1311a948-3ee8-4681-be70-716330ccf87c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:25 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2bbbd9a4-1387-4ead-a829-1dcc5cbe9aa8 tempest-ProjectMemberTests-550205305 None] Lock "cinder-4fd03353-8651-440d-879a-36bd03c186b5-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:25 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 1073741824" returned: 0 in 0.457s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:25 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255
Sep 20 17:10:25 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-fbb49837-0aa7-4b48-bfe9-97d5e984f260-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-fbb49837-0aa7-4b48-bfe9-97d5e984f260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-quobyte-fbb49837-0aa7-4b48-bfe9-97d5e984f260" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-fbb49837-0aa7-4b48-bfe9-97d5e984f260" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Deleting offline snapshot fbb49837-0aa7-4b48-bfe9-97d5e984f260 of volume 9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] snapshot_file for this snap is: volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd0a22b-8eb4-4580-9bd4-43e7ee4532ed]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:25 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364270601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c4c20-ee91-4576-b435-ea85164691ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:24Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Creating volume 254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:25 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927b5264-3e4d-411d-b823-aaf839024696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1b89a3-a35b-4244-9aed-8bef220d1255', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:25 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba 1073741824
Sep 20 17:10:25 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:25 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052c3418-0e78-4718-b62f-c03c43977d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:25 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Volume volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 (ad1b89a3-a35b-4244-9aed-8bef220d1255): created successfully
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052c3418-0e78-4718-b62f-c03c43977d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (f79d05e6-2b88-4d64-a089-54e797bb8566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-d3a85f54-ee5c-45ec-8baa-f87ab09af400 tempest-ProjectReaderTests-210649130 None] Created volume successfully.
Sep 20 17:10:26 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260
Sep 20 17:10:26 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-3eaf67f9-b584-484a-ac19-24a98c7da03f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "cinder-3eaf67f9-b584-484a-ac19-24a98c7da03f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a3ead-beb9-4910-9814-6d47bfa43b46]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:26 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f
Sep 20 17:10:26 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260" returned: 0 in 0.478s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b9031e8-59fc-441e-8b4d-5746e79569b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:26 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba 1073741824" returned: 0 in 0.478s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b1022-422a-41db-9ee4-6bee1465cd20]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:26 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba
Sep 20 17:10:26 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7
Sep 20 17:10:26 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:26 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f
Sep 20 17:10:26 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4a28f-4642-4407-aac3-4d8886bb72b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254c4c20-ee91-4576-b435-ea85164691ba', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7475bbf8-c004-4be6-b25c-bc0c7a185399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:26 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Volume volume-254c4c20-ee91-4576-b435-ea85164691ba (254c4c20-ee91-4576-b435-ea85164691ba): created successfully
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7475bbf8-c004-4be6-b25c-bc0c7a185399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (e41c9c24-cdfc-4b9f-82d7-466ccd220e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:26 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8fc3e6fb-ddac-40a3-b1a8-447eacf60009 tempest-ProjectReaderTests-1125936853 None] Created volume successfully.
Sep 20 17:10:26 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:26 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260
Sep 20 17:10:26 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:26 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-3eaf67f9-b584-484a-ac19-24a98c7da03f" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3eaf67f9-b584-484a-ac19-24a98c7da03f" released by "delete_volume" :: held 0.775s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Created reservations ['31170c7d-96e0-4600-a3f4-966eab569a22', 'c2534ba7-9d28-4ae0-bb93-c88ecc94086f', '1e19b296-635f-4b7c-a15a-efe404d98784', '63dcc4c8-d5a1-4f9b-8381-91c91cde1f8f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-ad1b89a3-a35b-4244-9aed-8bef220d1255-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:27 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:27 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "cinder-ad1b89a3-a35b-4244-9aed-8bef220d1255-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-quobyte-ad1b89a3-a35b-4244-9aed-8bef220d1255" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-ad1b89a3-a35b-4244-9aed-8bef220d1255" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3adc559-bfb6-4108-a167-93597743421b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260" returned: 0 in 0.471s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260
Sep 20 17:10:27 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Creating offline snapshot 5e66d9b7-4729-4c6f-80cc-30f0469d19cc of volume 254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[862a00f9-6559-4eae-9a8e-c344b0e406e9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255
Sep 20 17:10:27 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-0698b0d6-96e6-4c7a-9038-6636c07d3a8a tempest-ProjectMemberTests-550205305 None] Lock "cinder-3eaf67f9-b584-484a-ac19-24a98c7da03f-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:27 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba
Sep 20 17:10:27 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7.fbb49837-0aa7-4b48-bfe9-97d5e984f260" returned: 0 in 0.419s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:27 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255" returned: 0 in 0.486s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-fbb49837-0aa7-4b48-bfe9-97d5e984f260" released by "_delete_snapshot" :: held 1.902s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" released by "delete_snapshot" :: held 1.929s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:27 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255
Sep 20 17:10:27 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Created reservations ['3ff67b8b-aee7-4a2f-8595-66cc65dfb229', 'a7284b5e-53c9-40d9-8df8-4f14d7455367', '3eda89d3-e388-422e-ac79-f70c4e857de0', 'f1d07b26-0b00-4bfc-9881-97c4cf6650d7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (a58a7c00-e8ad-4595-a1f6-8a5efcf3b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8956561-779a-4897-88fc-3f22ca0858aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:27 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba" returned: 0 in 0.507s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8956561-779a-4897-88fc-3f22ca0858aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285020384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb540d9-d1a7-402b-91bb-b2600d573616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:28Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:27 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc 1G
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e645b16d-e967-4975-b0a9-0894d03b547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:27 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e645b16d-e967-4975-b0a9-0894d03b547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5125885e-e1c6-40b9-9e96-3e88d5203b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5125885e-e1c6-40b9-9e96-3e88d5203b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb540d9-d1a7-402b-91bb-b2600d573616', 'volume_name': 'volume-0bb540d9-d1a7-402b-91bb-b2600d573616', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3ae1c0-200e-4850-b8a2-ae3281d9be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3ae1c0-200e-4850-b8a2-ae3281d9be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542ef5a8-9c91-42a4-888f-8b059837c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:27 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Volume 0bb540d9-d1a7-402b-91bb-b2600d573616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb540d9-d1a7-402b-91bb-b2600d573616', 'volume_size': 1}
Sep 20 17:10:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Delete snapshot completed successfully.
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-9744deac-c284-4738-a50f-85cff1c636a1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-fbb49837-0aa7-4b48-bfe9-97d5e984f260-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:28 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-ad1b89a3-a35b-4244-9aed-8bef220d1255" returned: 0 in 0.322s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-ad1b89a3-a35b-4244-9aed-8bef220d1255" released by "delete_volume" :: held 0.885s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Created reservations ['b4e1c512-c2aa-4a8c-916d-e466aabe166b', 'b1803284-9e1d-4c92-a6f3-6d97114c46a9', '53aef2cc-fb82-4a28-a064-0bee7628ee6e', '16791fc0-3550-4584-9b46-e0ef8b7f15f5'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:28 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:28 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:28 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc 1G" returned: 0 in 0.487s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c4c20-ee91-4576-b435-ea85164691ba -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:28 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c4c20-ee91-4576-b435-ea85164691ba -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc
Sep 20 17:10:28 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:28 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.266s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:28 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Deleted volume successfully.
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-172e066f-cd45-4da0-afb5-554d2872d959 tempest-ProjectReaderTests-210649130 None] Lock "cinder-ad1b89a3-a35b-4244-9aed-8bef220d1255-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:28 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c4c20-ee91-4576-b435-ea85164691ba -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc" returned: 0 in 0.314s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:28 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc is being set with open permissions: ugo+rw
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:28 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc
Sep 20 17:10:28 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (9117a304-825c-4d40-8a47-d5404d145128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bc6f7d-5613-4f4e-bd41-c821051b5a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bc6f7d-5613-4f4e-bd41-c821051b5a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329344049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710d5a56-62cc-4ce5-93c3-273614c99322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:29Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51517809-9c28-4663-9019-f22d48e2a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51517809-9c28-4663-9019-f22d48e2a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f73623-82f2-40ff-b122-cc7dd63c5f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f73623-82f2-40ff-b122-cc7dd63c5f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710d5a56-62cc-4ce5-93c3-273614c99322', 'volume_name': 'volume-710d5a56-62cc-4ce5-93c3-273614c99322', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9d5608-9a8c-4ab3-a9de-2a0146550867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9d5608-9a8c-4ab3-a9de-2a0146550867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c28438-a267-4fb7-9ac3-5ea43f972bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:28 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Volume 710d5a56-62cc-4ce5-93c3-273614c99322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710d5a56-62cc-4ce5-93c3-273614c99322', 'volume_size': 1}
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:28 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-9b9031e8-59fc-441e-8b4d-5746e79569b7-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:29 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info
Sep 20 17:10:29 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-9b9031e8-59fc-441e-8b4d-5746e79569b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" acquired by "delete_volume" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c91b93-0e70-4fab-82b3-a3ba40b33b0a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7
Sep 20 17:10:29 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:29 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info" returned: 0 in 0.279s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:29 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info is being set with open permissions: ugo+rw
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info
Sep 20 17:10:29 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:29 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.info" returned: 0 in 0.238s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:29 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7
Sep 20 17:10:29 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285020384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb540d9-d1a7-402b-91bb-b2600d573616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:28Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Creating volume 0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:29 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 1073741824
Sep 20 17:10:29 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:29 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2b5c3d90-9d55-41c5-809a-13970ff30ffb tempest-ProjectReaderTests-1125936853 None] Create snapshot completed successfully
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-9b9031e8-59fc-441e-8b4d-5746e79569b7" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:29 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-9b9031e8-59fc-441e-8b4d-5746e79569b7" released by "delete_volume" :: held 0.694s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Created reservations ['12f50571-03d8-41a1-89ef-071136f062ef', 'a72807ec-7af4-4a74-8eda-dfbb0d5e330b', 'ebc1c77f-a82f-472d-a205-8f791bd13277', '06a2f03c-c093-4976-b3ed-efe994a3a61b'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:29 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:29 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 1073741824" returned: 0 in 0.450s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616
Sep 20 17:10:30 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-efb9b999-0cd9-4aaf-b678-54fda45ce703-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:30 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Deleted volume successfully.
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-efb9b999-0cd9-4aaf-b678-54fda45ce703-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2f5d6edf-7b3f-43f0-9cac-8580b0397ba1 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-9b9031e8-59fc-441e-8b4d-5746e79569b7-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "cinder-quobyte-efb9b999-0cd9-4aaf-b678-54fda45ce703" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-efb9b999-0cd9-4aaf-b678-54fda45ce703" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7198b114-cfa5-4363-bd9b-25b57b6bc226]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616" returned: 0 in 0.285s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329344049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710d5a56-62cc-4ce5-93c3-273614c99322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a68bf6fcc645ca9e48619702672067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:29Z,use_quota=True,user_id='ebfe3d8bad264cb28ef7d00ae58fb8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Creating volume 710d5a56-62cc-4ce5-93c3-273614c99322 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:30 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542ef5a8-9c91-42a4-888f-8b059837c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb540d9-d1a7-402b-91bb-b2600d573616', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ffe74f-f55b-4ba8-9df3-6c7d702fe060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:30 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 1073741824
Sep 20 17:10:30 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Volume volume-0bb540d9-d1a7-402b-91bb-b2600d573616 (0bb540d9-d1a7-402b-91bb-b2600d573616): created successfully
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ffe74f-f55b-4ba8-9df3-6c7d702fe060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:30 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703
Sep 20 17:10:30 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (a58a7c00-e8ad-4595-a1f6-8a5efcf3b047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dc9340c2-0003-42d1-860a-6e89087dfec6 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-5e66d9b7-4729-4c6f-80cc-30f0469d19cc-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-5e66d9b7-4729-4c6f-80cc-30f0469d19cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-5e66d9b7-4729-4c6f-80cc-30f0469d19cc" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-5e66d9b7-4729-4c6f-80cc-30f0469d19cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Deleting offline snapshot 5e66d9b7-4729-4c6f-80cc-30f0469d19cc of volume 254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] snapshot_file for this snap is: volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea6796-cd15-44a2-ad9c-50060f673d0f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703" returned: 0 in 0.380s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703
Sep 20 17:10:30 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc
Sep 20 17:10:30 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 1073741824" returned: 0 in 0.538s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:30 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322
Sep 20 17:10:30 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:30 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-efb9b999-0cd9-4aaf-b678-54fda45ce703" returned: 0 in 0.314s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-quobyte-efb9b999-0cd9-4aaf-b678-54fda45ce703" released by "delete_volume" :: held 0.744s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:31 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc" returned: 0 in 0.444s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-254c4c20-ee91-4576-b435-ea85164691ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11dd54-b654-45ee-85f1-6d5585fe29f4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Created reservations ['c82f05ec-9971-4ff6-a4cd-0f8a2d01f55b', '4b64797b-007c-47da-9040-0228aafd7d9b', '01617f1e-555d-4026-8483-8a951f1489a3', '369f2e79-ba43-4348-8c79-3c2859fc0bd3'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:31 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:31 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:31 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322" returned: 0 in 0.309s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:31 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba
Sep 20 17:10:31 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.059s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c28438-a267-4fb7-9ac3-5ea43f972bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710d5a56-62cc-4ce5-93c3-273614c99322', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a370e7-047b-4b71-882c-7598cd690460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 931d08f3-775e-436f-b11e-24390eb1b33c of volume 0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Volume volume-710d5a56-62cc-4ce5-93c3-273614c99322 (710d5a56-62cc-4ce5-93c3-273614c99322): created successfully
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a370e7-047b-4b71-882c-7598cd690460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Flow 'volume_create_manager' (9117a304-825c-4d40-8a47-d5404d145128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e355995-422d-42e6-ab7f-fe80f3800ab2]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-376297a9-adda-44c8-99d1-7eb5e265867f tempest-ProjectReaderTests-210649130 None] Created volume successfully.
Sep 20 17:10:31 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616
Sep 20 17:10:31 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:31 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Deleted volume successfully.
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e7561145-de75-424c-b9ce-ad74b22a09b4 tempest-CinderUnicodeTest-2043624947 None] Lock "cinder-efb9b999-0cd9-4aaf-b678-54fda45ce703-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:31 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba" returned: 0 in 0.511s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:31 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc
Sep 20 17:10:31 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:31 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616" returned: 0 in 0.484s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:31 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c 1G
Sep 20 17:10:31 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-710d5a56-62cc-4ce5-93c3-273614c99322-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "cinder-710d5a56-62cc-4ce5-93c3-273614c99322-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Acquiring lock "cinder-quobyte-710d5a56-62cc-4ce5-93c3-273614c99322" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:32 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc" returned: 0 in 0.498s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-710d5a56-62cc-4ce5-93c3-273614c99322" acquired by "delete_volume" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:32 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc
Sep 20 17:10:32 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a31612-4100-4845-9dc8-fd57255a7172]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:32 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322
Sep 20 17:10:32 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c 1G" returned: 0 in 0.563s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb540d9-d1a7-402b-91bb-b2600d573616 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:32 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb540d9-d1a7-402b-91bb-b2600d573616 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c
Sep 20 17:10:32 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba.5e66d9b7-4729-4c6f-80cc-30f0469d19cc" returned: 0 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-5e66d9b7-4729-4c6f-80cc-30f0469d19cc" released by "_delete_snapshot" :: held 1.914s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" released by "delete_snapshot" :: held 1.941s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Created reservations ['f28665ad-9ab9-43af-a7a4-1ad293a48434', '709f7273-edc3-4583-b767-d2ed08b2c665', '7073be15-53ac-4ed8-a9f4-0c2c28b82cd1', '7c01da8d-c9e1-4ba3-a1b6-372e28ea44d2'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:32 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Delete snapshot completed successfully.
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-01d0f3c0-ac31-4b36-9c5f-b729ba0efd1b tempest-ProjectReaderTests-1125936853 None] Lock "cinder-5e66d9b7-4729-4c6f-80cc-30f0469d19cc-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:32 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322" returned: 0 in 0.514s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:32 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322
Sep 20 17:10:32 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-254c4c20-ee91-4576-b435-ea85164691ba-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-254c4c20-ee91-4576-b435-ea85164691ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:32 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb540d9-d1a7-402b-91bb-b2600d573616 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c" returned: 0 in 0.402s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:32 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c is being set with open permissions: ugo+rw
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:32 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c
Sep 20 17:10:32 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576e340-00f3-4032-beb7-f0d38e71b4d6]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:33 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-710d5a56-62cc-4ce5-93c3-273614c99322" returned: 0 in 0.325s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "cinder-quobyte-710d5a56-62cc-4ce5-93c3-273614c99322" released by "delete_volume" :: held 0.925s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:33 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba
Sep 20 17:10:33 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:33 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c" returned: 0 in 0.333s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Created reservations ['22d0f963-b03f-462c-9a7d-99bf2aa8d0ea', '881bd5b8-1fdf-4c90-b0ee-762a293d5e88', '34345679-52cc-476f-9d43-8af78fc63c00', 'b275d0b4-0051-433e-a1fd-8d1769a71319'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:33 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info
Sep 20 17:10:33 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:33 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:33 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:33 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba" returned: 0 in 0.505s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:33 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba
Sep 20 17:10:33 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:33 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info is being set with open permissions: ugo+rw
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:33 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info
Sep 20 17:10:33 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:33 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Deleted volume successfully.
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8a18fc76-a600-4e83-bb78-23c7d08571c9 tempest-ProjectReaderTests-210649130 None] Lock "cinder-710d5a56-62cc-4ce5-93c3-273614c99322-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:33 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-254c4c20-ee91-4576-b435-ea85164691ba" returned: 0 in 0.326s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-254c4c20-ee91-4576-b435-ea85164691ba" released by "delete_volume" :: held 0.934s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:33 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.info" returned: 0 in 0.309s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Created reservations ['50fc5d6e-b7ac-4cee-b329-d886f7eaad0d', 'bc0301e1-df36-494e-a2ea-b244c99947f8', '1dbdeb08-3fb6-4178-9426-eddace44338a', 'f5af6b0e-fc0a-4bc8-8d22-d00ab839a10a'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-168ccb15-c147-41c1-bdbb-158550de3833 tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:34 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:34 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:34 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.286s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Deleted volume successfully.
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-4a3989b8-6727-40fc-b16e-a0b7d506b832 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-254c4c20-ee91-4576-b435-ea85164691ba-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-931d08f3-775e-436f-b11e-24390eb1b33c-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-931d08f3-775e-436f-b11e-24390eb1b33c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-931d08f3-775e-436f-b11e-24390eb1b33c" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-931d08f3-775e-436f-b11e-24390eb1b33c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 931d08f3-775e-436f-b11e-24390eb1b33c of volume 0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd6d80-1f05-4f2d-8fd1-b35531a3be9f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:34 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c
Sep 20 17:10:34 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:34 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c" returned: 0 in 0.432s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb540d9-d1a7-402b-91bb-b2600d573616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f92f6-333d-4b90-83d1-56df35282c86]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:35 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616
Sep 20 17:10:35 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:35 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616" returned: 0 in 0.527s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:35 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c
Sep 20 17:10:35 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (f2e722c5-8bd7-4e40-b70a-7c4bfe750014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351dbbaf-1b66-45bc-8e3d-29d765b9f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351dbbaf-1b66-45bc-8e3d-29d765b9f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470095181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72252567-37a7-4488-82b4-9b79f99547ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:36Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134d7042-14ca-4e1f-b965-2caef32c14ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134d7042-14ca-4e1f-b965-2caef32c14ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321fdbf4-2d63-4ea4-8487-77a180274882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321fdbf4-2d63-4ea4-8487-77a180274882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72252567-37a7-4488-82b4-9b79f99547ce', 'volume_name': 'volume-72252567-37a7-4488-82b4-9b79f99547ce', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5486dfb2-e90d-45c7-8261-872fe435bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5486dfb2-e90d-45c7-8261-872fe435bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5e610-52f6-4163-b0e9-3c8ca96960b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:35 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Volume 72252567-37a7-4488-82b4-9b79f99547ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72252567-37a7-4488-82b4-9b79f99547ce', 'volume_size': 1}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470095181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72252567-37a7-4488-82b4-9b79f99547ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f512d38f3567440ba046fc89c6a0dd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:36Z,use_quota=True,user_id='a269a75885624cd5b23f7ab4cfb9fb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Creating volume 72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:35 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:35 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce 1073741824
Sep 20 17:10:35 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:35 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c" returned: 0 in 0.452s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:35 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c
Sep 20 17:10:35 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:36 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616.931d08f3-775e-436f-b11e-24390eb1b33c" returned: 0 in 0.356s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:36 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce 1073741824" returned: 0 in 0.636s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-931d08f3-775e-436f-b11e-24390eb1b33c" released by "_delete_snapshot" :: held 1.953s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" released by "delete_snapshot" :: held 1.979s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:36 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce
Sep 20 17:10:36 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Created reservations ['c7821943-ff44-4df2-85ef-dc59ce64066a', '2fe69c7e-d19d-4821-b826-69b1d2b27841', '80ef9c7f-58cd-4926-8c4d-b29cd8f9483e', 'f3bfeaa9-5f46-4f80-a5bd-34ecfdde77bf'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-82ec5203-0d39-4b89-8e8b-13a9c19a4014 tempest-ProjectMemberTests-550205305 None] Lock "cinder-931d08f3-775e-436f-b11e-24390eb1b33c-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:36 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce" returned: 0 in 0.372s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5e610-52f6-4163-b0e9-3c8ca96960b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72252567-37a7-4488-82b4-9b79f99547ce', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41e3895-4e16-44d7-ac40-cc0b3bc1c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:36 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Volume volume-72252567-37a7-4488-82b4-9b79f99547ce (72252567-37a7-4488-82b4-9b79f99547ce): created successfully
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41e3895-4e16-44d7-ac40-cc0b3bc1c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:36 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Flow 'volume_create_manager' (f2e722c5-8bd7-4e40-b70a-7c4bfe750014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-b4b1bd46-e629-4c57-8c34-133863941ab6 tempest-ProjectReaderTests-1125936853 None] Created volume successfully.
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-0bb540d9-d1a7-402b-91bb-b2600d573616-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "cinder-0bb540d9-d1a7-402b-91bb-b2600d573616-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b353c8-b9d6-49a5-8422-dd4385935f17]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Creating offline snapshot 71fa7ab4-5eac-4656-91be-62e88f9ea37c of volume 72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:37 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616
Sep 20 17:10:37 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3190fe-420f-4a34-89a7-ec9954c35971]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:38 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce
Sep 20 17:10:38 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:38 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616" returned: 0 in 0.442s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:38 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616
Sep 20 17:10:38 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:38 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce" returned: 0 in 0.429s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:38 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c 1G
Sep 20 17:10:38 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:38 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-0bb540d9-d1a7-402b-91bb-b2600d573616" returned: 0 in 0.275s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-0bb540d9-d1a7-402b-91bb-b2600d573616" released by "delete_volume" :: held 0.799s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Created reservations ['4bfaf64d-7450-4bfa-92eb-223041655487', '09a9c3e6-4067-406d-b718-5e4844d431d0', 'fab95fbf-a0b6-49f9-8410-6cb2e603999a', '94227850-3cfa-437c-82ff-64d0c7f8ac70'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:38 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:38 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:38 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c 1G" returned: 0 in 0.529s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72252567-37a7-4488-82b4-9b79f99547ce -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:38 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.289s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:38 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:38 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:10:38 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72252567-37a7-4488-82b4-9b79f99547ce -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c
Sep 20 17:10:39 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-875951d1-5c25-484f-8b57-8e02b3f5b161 tempest-ProjectMemberTests-550205305 None] Lock "cinder-0bb540d9-d1a7-402b-91bb-b2600d573616-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:39 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72252567-37a7-4488-82b4-9b79f99547ce -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:39 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c is being set with open permissions: ugo+rw
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:39 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c
Sep 20 17:10:39 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (da5a9623-5f6a-46db-a6e0-5f891218180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decddebd-81c6-4f75-82da-8f075faf0657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decddebd-81c6-4f75-82da-8f075faf0657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697578109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583e993-ec2a-446d-9ecb-cb877d9e3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:39Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7403f3-cc0d-4376-90bf-154c99968310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7403f3-cc0d-4376-90bf-154c99968310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908df27d-07ea-4590-b5d8-899321c36a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908df27d-07ea-4590-b5d8-899321c36a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a583e993-ec2a-446d-9ecb-cb877d9e3a93', 'volume_name': 'volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082992e9-573b-40ae-b566-0ca9669f50c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082992e9-573b-40ae-b566-0ca9669f50c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec2b7e1-245d-464a-9ebd-429c06f9e6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:39 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Volume a583e993-ec2a-446d-9ecb-cb877d9e3a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93', 'volume_size': 1}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:39 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:39 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info
Sep 20 17:10:39 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:39 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:39 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info is being set with open permissions: ugo+rw
Sep 20 17:10:39 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:39 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info
Sep 20 17:10:39 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.info" returned: 0 in 0.263s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697578109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583e993-ec2a-446d-9ecb-cb877d9e3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:39Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Creating volume a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:40 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:40 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 1073741824
Sep 20 17:10:40 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:40 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-9d631993-ffe8-4b06-97af-c955693a9296 tempest-ProjectReaderTests-1125936853 None] Create snapshot completed successfully
Sep 20 17:10:40 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 1073741824" returned: 0 in 0.461s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:40 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93
Sep 20 17:10:40 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:40 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93" returned: 0 in 0.247s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec2b7e1-245d-464a-9ebd-429c06f9e6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ff04c-7e3a-4deb-a159-2717ec416553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:40 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Volume volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 (a583e993-ec2a-446d-9ecb-cb877d9e3a93): created successfully
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ff04c-7e3a-4deb-a159-2717ec416553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:40 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (da5a9623-5f6a-46db-a6e0-5f891218180c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:41 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-31972150-73e4-4f9e-887d-24a3e15bedb8 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-71fa7ab4-5eac-4656-91be-62e88f9ea37c-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-71fa7ab4-5eac-4656-91be-62e88f9ea37c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-71fa7ab4-5eac-4656-91be-62e88f9ea37c" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-71fa7ab4-5eac-4656-91be-62e88f9ea37c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Deleting offline snapshot 71fa7ab4-5eac-4656-91be-62e88f9ea37c of volume 72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] snapshot_file for this snap is: volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b936aa-262f-4bd6-8a84-7cbeb09222e3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:41 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c
Sep 20 17:10:41 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:41 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c" returned: 0 in 0.432s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72252567-37a7-4488-82b4-9b79f99547ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[761642df-37f7-4076-b5f1-73018ea7ca58]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 9cc2e110-6ff2-4bab-8705-11cdeca57e7f of volume a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[511284fc-9069-4a79-b008-b4b96f64c676]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:41 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce
Sep 20 17:10:41 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:41 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93
Sep 20 17:10:41 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:42 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce" returned: 0 in 0.404s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:42 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c
Sep 20 17:10:42 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:42 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93" returned: 0 in 0.421s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:42 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f 1G
Sep 20 17:10:42 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:42 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c" returned: 0 in 0.428s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:42 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c
Sep 20 17:10:42 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:42 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f 1G" returned: 0 in 0.504s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:42 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f
Sep 20 17:10:42 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:42 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce.71fa7ab4-5eac-4656-91be-62e88f9ea37c" returned: 0 in 0.320s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-71fa7ab4-5eac-4656-91be-62e88f9ea37c" released by "_delete_snapshot" :: held 1.711s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" released by "delete_snapshot" :: held 1.737s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:42 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Created reservations ['a342a216-4c4f-453e-8efb-03a82bb6e64e', '060f7da1-cbec-4c23-8903-97e1a151288e', 'ddcdfa0d-8e71-4b79-a358-3280d84526bf', 'c7b87775-8328-4048-813f-c93b7c600996'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:43 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f" returned: 0 in 0.361s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:43 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f is being set with open permissions: ugo+rw
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Delete snapshot completed successfully.
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ce85a38f-2197-4b60-b76c-c7b8e68d4ac6 tempest-ProjectReaderTests-1125936853 None] Lock "cinder-71fa7ab4-5eac-4656-91be-62e88f9ea37c-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:43 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f
Sep 20 17:10:43 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:43 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-72252567-37a7-4488-82b4-9b79f99547ce-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f" returned: 0 in 0.291s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-72252567-37a7-4488-82b4-9b79f99547ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:43 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info
Sep 20 17:10:43 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae29bf14-09d7-4ea6-83c8-2fe84ee8407c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:43 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce
Sep 20 17:10:43 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:43 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info" returned: 0 in 0.271s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:43 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info is being set with open permissions: ugo+rw
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:43 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info
Sep 20 17:10:43 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:43 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce" returned: 0 in 0.402s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:43 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:43 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce
Sep 20 17:10:43 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.info" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:43 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-06492205-5d6d-4428-b75d-3a078548a73c tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:10:44 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-72252567-37a7-4488-82b4-9b79f99547ce" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-quobyte-72252567-37a7-4488-82b4-9b79f99547ce" released by "delete_volume" :: held 0.739s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Created reservations ['50fbd607-50b7-4a0b-9fe9-4ecb8a71ba25', '484123b6-5b85-4a2e-8de6-9da7d1eaf3e7', '48512791-cfb0-4b34-947c-8a41b61d87e2', '24ba8c2f-4056-4e2b-b871-33bd042804b7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:44 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:44 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:44 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:44 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Deleted volume successfully.
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-2902826d-357d-4ead-876b-02271c181abd tempest-ProjectReaderTests-1125936853 None] Lock "cinder-72252567-37a7-4488-82b4-9b79f99547ce-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-9cc2e110-6ff2-4bab-8705-11cdeca57e7f-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-9cc2e110-6ff2-4bab-8705-11cdeca57e7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-9cc2e110-6ff2-4bab-8705-11cdeca57e7f" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-9cc2e110-6ff2-4bab-8705-11cdeca57e7f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 9cc2e110-6ff2-4bab-8705-11cdeca57e7f of volume a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:44 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70acd3-2d90-4e7f-80a6-63f6754e53b7]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:45 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f
Sep 20 17:10:45 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:45 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f" returned: 0 in 0.403s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc665a4d-7f39-44f4-9b07-5f4389df5637]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:45 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93
Sep 20 17:10:45 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:45 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:45 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f
Sep 20 17:10:45 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:46 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:46 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f
Sep 20 17:10:46 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:46 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93.9cc2e110-6ff2-4bab-8705-11cdeca57e7f" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-9cc2e110-6ff2-4bab-8705-11cdeca57e7f" released by "_delete_snapshot" :: held 1.617s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" released by "delete_snapshot" :: held 1.652s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Created reservations ['ea881421-f065-484e-9d20-e6c0058e7027', '0600bde1-a66f-4d6c-98dc-9ed24f240463', 'd7937978-a612-4d07-ac19-8ea03a00a647', '998f0b5a-81f9-4649-9c97-29cc4d00884f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:46 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:10:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-24087a87-209b-4cfe-908b-51efa14d3275 tempest-ProjectMemberTests-550205305 None] Lock "cinder-9cc2e110-6ff2-4bab-8705-11cdeca57e7f-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-a583e993-ec2a-446d-9ecb-cb877d9e3a93-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "cinder-a583e993-ec2a-446d-9ecb-cb877d9e3a93-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925f96f-91ec-4108-a00e-a622ff10da78]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:47 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93
Sep 20 17:10:47 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:47 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:47 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93
Sep 20 17:10:47 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:47 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-a583e993-ec2a-446d-9ecb-cb877d9e3a93" returned: 0 in 0.278s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a583e993-ec2a-446d-9ecb-cb877d9e3a93" released by "delete_volume" :: held 0.774s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:47 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Created reservations ['ba6fe0da-b6a8-48b7-8bbf-d1a63511f0e1', '6e955060-0c10-47dd-a2ac-d9e296f09238', '0eca2e86-cf1d-4482-8eac-0ff407de669b', '0c693a1f-a2c6-423e-9274-54eda63910de'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:48 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:48 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:48 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.298s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:48 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-16fc8df2-3886-4303-a197-9b1383372a28 tempest-ProjectMemberTests-550205305 None] Lock "cinder-a583e993-ec2a-446d-9ecb-cb877d9e3a93-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:48 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (9eb7bdc7-b310-44aa-aa4e-caa09c0a5f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e243ba-35e4-4462-bf10-e64aca326bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e243ba-35e4-4462-bf10-e64aca326bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877599767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752b694f-5f25-4585-a4c5-5042b99c475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:49Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08c6fe8-75b9-48f7-85e6-48e99c104724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08c6fe8-75b9-48f7-85e6-48e99c104724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb13aa5-cfef-466b-90a3-0ee2abcace23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb13aa5-cfef-466b-90a3-0ee2abcace23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752b694f-5f25-4585-a4c5-5042b99c475a', 'volume_name': 'volume-752b694f-5f25-4585-a4c5-5042b99c475a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f45bb7-6635-40d5-a149-cda07791833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f45bb7-6635-40d5-a149-cda07791833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb67193-eb66-40d0-9537-ddab0a6914a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Volume 752b694f-5f25-4585-a4c5-5042b99c475a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752b694f-5f25-4585-a4c5-5042b99c475a', 'volume_size': 1}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877599767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752b694f-5f25-4585-a4c5-5042b99c475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:49Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Creating volume 752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:49 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:49 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a 1073741824
Sep 20 17:10:49 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:49 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a 1073741824" returned: 0 in 0.420s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:49 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a
Sep 20 17:10:49 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:49 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a" returned: 0 in 0.268s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb67193-eb66-40d0-9537-ddab0a6914a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752b694f-5f25-4585-a4c5-5042b99c475a', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274e479b-9d67-4ab5-9d39-3b6f3a84dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:49 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Volume volume-752b694f-5f25-4585-a4c5-5042b99c475a (752b694f-5f25-4585-a4c5-5042b99c475a): created successfully
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274e479b-9d67-4ab5-9d39-3b6f3a84dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:49 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (9eb7bdc7-b310-44aa-aa4e-caa09c0a5f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:49 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-428b4595-e5f8-4792-9d25-bc07f6cccae5 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c of volume 752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7e395-cc8e-4f5e-bfad-912c214791dd]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:51 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a
Sep 20 17:10:51 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:51 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a" returned: 0 in 0.402s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:51 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c 1G
Sep 20 17:10:51 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:52 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c 1G" returned: 0 in 0.415s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752b694f-5f25-4585-a4c5-5042b99c475a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:52 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752b694f-5f25-4585-a4c5-5042b99c475a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c
Sep 20 17:10:52 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:52 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752b694f-5f25-4585-a4c5-5042b99c475a -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" returned: 0 in 0.303s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:52 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c is being set with open permissions: ugo+rw
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:52 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c
Sep 20 17:10:52 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:52 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" returned: 0 in 0.243s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:52 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info
Sep 20 17:10:52 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:52 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:52 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info is being set with open permissions: ugo+rw
Sep 20 17:10:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:52 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info
Sep 20 17:10:52 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:53 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.info" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ffc03978-4b8e-4fb7-8c55-9f8bf9072062 tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c of volume 752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3470eff-bcb7-4ecf-8dd3-f7f179b36c74]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:54 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c
Sep 20 17:10:54 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:54 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" returned: 0 in 0.366s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-752b694f-5f25-4585-a4c5-5042b99c475a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0deadba-8125-44ca-9df5-7025e9778b99]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:54 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a
Sep 20 17:10:54 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:55 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a" returned: 0 in 0.381s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:55 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c
Sep 20 17:10:55 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:55 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" returned: 0 in 0.348s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:55 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c
Sep 20 17:10:55 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:55 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a.3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c" released by "_delete_snapshot" :: held 1.505s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" released by "delete_snapshot" :: held 1.525s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Created reservations ['4f2a158d-1d73-4a22-8f9d-8bb992de1a8a', '154f3567-b76f-4107-a886-b0b11a2b6ba8', '85a0e0a2-cf78-4e0e-8f4c-8057e2a82191', '886540e0-0542-463e-89ed-28d0951aab5f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:10:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-df1578ae-1ab4-42aa-9348-1c6b1d60d8a1 tempest-ProjectMemberTests-550205305 None] Lock "cinder-3d2c71a3-0d4b-4e21-a3ac-ba4a90894d8c-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-752b694f-5f25-4585-a4c5-5042b99c475a-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "cinder-752b694f-5f25-4585-a4c5-5042b99c475a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a01d96-c512-445c-bcd8-2e906423a5b5]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:56 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a
Sep 20 17:10:56 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:56 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:56 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:56 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a
Sep 20 17:10:56 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:57 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-752b694f-5f25-4585-a4c5-5042b99c475a" returned: 0 in 0.325s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-752b694f-5f25-4585-a4c5-5042b99c475a" released by "delete_volume" :: held 0.780s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Created reservations ['b1950f80-5fb1-4e2e-93a0-010d5f063cbb', '457bb4d0-6d0c-4f1a-a85f-a379e825651f', '6ab2f103-157e-44fd-a028-1437d63e1a18', '34a00d88-98e6-445b-a9cf-592c775507ee'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:57 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:57 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:57 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.326s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:57 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:10:57 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bbfbf1a3-8217-4d9c-9e91-74f1a3f1d9c9 tempest-ProjectMemberTests-550205305 None] Lock "cinder-752b694f-5f25-4585-a4c5-5042b99c475a-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (f8e50d9a-d7de-47db-bd64-7067080b84e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e5bdda-239a-4893-a9db-a82cf900c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e5bdda-239a-4893-a9db-a82cf900c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812100084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f235dbe3-4257-4104-ad21-fde5ef7db2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:58Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e801098-cf20-4e23-869e-81bc2435050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e801098-cf20-4e23-869e-81bc2435050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2f0f4c-2be3-41a9-b032-a33cb6d08f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2f0f4c-2be3-41a9-b032-a33cb6d08f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f235dbe3-4257-4104-ad21-fde5ef7db2db', 'volume_name': 'volume-f235dbe3-4257-4104-ad21-fde5ef7db2db', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8e564a-53e6-40f0-bffc-ceb7b54bc61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8e564a-53e6-40f0-bffc-ceb7b54bc61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d82bf48-b267-4eed-acf8-1255401c1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:58 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Volume f235dbe3-4257-4104-ad21-fde5ef7db2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f235dbe3-4257-4104-ad21-fde5ef7db2db', 'volume_size': 1}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812100084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f235dbe3-4257-4104-ad21-fde5ef7db2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:10:58Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Creating volume f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:10:58 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:58 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db 1073741824
Sep 20 17:10:58 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:58 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:10:58 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:58 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:10:58 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db 1073741824" returned: 0 in 0.492s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:10:58 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db
Sep 20 17:10:58 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:10:58 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db" returned: 0 in 0.273s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d82bf48-b267-4eed-acf8-1255401c1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f235dbe3-4257-4104-ad21-fde5ef7db2db', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74f185f-9044-4802-879f-d34e63cc092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:10:59 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Volume volume-f235dbe3-4257-4104-ad21-fde5ef7db2db (f235dbe3-4257-4104-ad21-fde5ef7db2db): created successfully
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74f185f-9044-4802-879f-d34e63cc092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:10:59 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (f8e50d9a-d7de-47db-bd64-7067080b84e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:10:59 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-98a4f39b-220f-4d1f-b0ec-2ffc86d77435 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Creating offline snapshot a3413347-da76-426e-999f-2326ce2c86b6 of volume f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[007c7d12-e7e0-46c2-992a-a8650286f16b]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:00 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db
Sep 20 17:11:00 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:00 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db" returned: 0 in 0.365s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:00 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:00 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 1G
Sep 20 17:11:00 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:01 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 1G" returned: 0 in 0.541s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f235dbe3-4257-4104-ad21-fde5ef7db2db -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:01 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f235dbe3-4257-4104-ad21-fde5ef7db2db -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6
Sep 20 17:11:01 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:01 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f235dbe3-4257-4104-ad21-fde5ef7db2db -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6" returned: 0 in 0.306s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:01 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 is being set with open permissions: ugo+rw
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:01 devstack sudo[107581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6
Sep 20 17:11:01 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:01 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6" returned: 0 in 0.238s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:01 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:01 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info
Sep 20 17:11:01 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:02 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info" returned: 0 in 0.277s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:02 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info is being set with open permissions: ugo+rw
Sep 20 17:11:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:02 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info
Sep 20 17:11:02 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:02 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.info" returned: 0 in 0.269s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:02 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:02 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-039822fc-4982-4ef8-ac0b-0ca2facc513a tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-a3413347-da76-426e-999f-2326ce2c86b6-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-a3413347-da76-426e-999f-2326ce2c86b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-a3413347-da76-426e-999f-2326ce2c86b6" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a3413347-da76-426e-999f-2326ce2c86b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot a3413347-da76-426e-999f-2326ce2c86b6 of volume f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[830ef6d9-29c6-429c-a464-4a6cb393bb00]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:03 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:03 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6
Sep 20 17:11:03 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:04 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f235dbe3-4257-4104-ad21-fde5ef7db2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c341a8e-ebcc-4f08-a0b0-17e75c7520e0]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:04 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db
Sep 20 17:11:04 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:04 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db" returned: 0 in 0.375s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:04 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6
Sep 20 17:11:04 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:04 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:04 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:04 devstack sudo[107606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6
Sep 20 17:11:04 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:05 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db.a3413347-da76-426e-999f-2326ce2c86b6" returned: 0 in 0.300s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-a3413347-da76-426e-999f-2326ce2c86b6" released by "_delete_snapshot" :: held 1.551s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" released by "delete_snapshot" :: held 1.574s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Created reservations ['2c1b3664-3869-435b-9792-0e9c1423758b', '40851c30-2069-413b-9c90-7ba0b818a2b3', '853b6113-0a92-481b-bd9a-cf2c017c83c8', 'e92dd486-2479-41f6-a1e6-c3aad91228df'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:05 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-cb29e227-f3cb-4804-a176-5310b196016c tempest-ProjectMemberTests-550205305 None] Lock "cinder-a3413347-da76-426e-999f-2326ce2c86b6-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-f235dbe3-4257-4104-ad21-fde5ef7db2db-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "cinder-f235dbe3-4257-4104-ad21-fde5ef7db2db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" acquired by "delete_volume" :: waited 0.020s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[969191c9-c59d-4a29-8c35-f9006c5ec86f]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:05 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:05 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db
Sep 20 17:11:05 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:06 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db" returned: 0 in 0.369s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:06 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db
Sep 20 17:11:06 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:06 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f235dbe3-4257-4104-ad21-fde5ef7db2db" returned: 0 in 0.265s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f235dbe3-4257-4104-ad21-fde5ef7db2db" released by "delete_volume" :: held 0.708s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Created reservations ['f4697c9d-3a6f-48cc-850c-e014cb49db12', 'd214ef0d-6123-4292-ab60-21df4e3e0c62', '15d61a1f-2007-4147-957b-18bd3b3d9df3', '3b0ad5bd-30db-42ad-aea9-dc9572b0a717'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:06 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:06 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:06 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.259s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:06 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:11:06 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c72a58a5-da54-44c0-84f2-e18c242b66c5 tempest-ProjectMemberTests-550205305 None] Lock "cinder-f235dbe3-4257-4104-ad21-fde5ef7db2db-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (08aa9322-1e6f-49b2-9151-1408da28e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681f2a5-94bf-45d6-a2fc-8a7a3b08253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681f2a5-94bf-45d6-a2fc-8a7a3b08253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627023782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78588c7f-98fe-4e73-9842-9580356f6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:07Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b224945-9b9d-4a2a-9513-534bd81c30ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b224945-9b9d-4a2a-9513-534bd81c30ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad9b4c2-8c9f-452d-a512-13beaa1d62dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad9b4c2-8c9f-452d-a512-13beaa1d62dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78588c7f-98fe-4e73-9842-9580356f6bc2', 'volume_name': 'volume-78588c7f-98fe-4e73-9842-9580356f6bc2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eba455f-3fa2-42f5-95fb-3f004dc60d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eba455f-3fa2-42f5-95fb-3f004dc60d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28ed769-d732-4a99-92ad-b0b35756f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:07 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Volume 78588c7f-98fe-4e73-9842-9580356f6bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78588c7f-98fe-4e73-9842-9580356f6bc2', 'volume_size': 1}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627023782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78588c7f-98fe-4e73-9842-9580356f6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:07Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Creating volume 78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:07 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:07 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 1073741824
Sep 20 17:11:07 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:07 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 1073741824" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:07 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:07 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2
Sep 20 17:11:07 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:08 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2" returned: 0 in 0.258s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28ed769-d732-4a99-92ad-b0b35756f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78588c7f-98fe-4e73-9842-9580356f6bc2', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcded27-b52a-4a59-a8ad-e2088b00ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:08 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Volume volume-78588c7f-98fe-4e73-9842-9580356f6bc2 (78588c7f-98fe-4e73-9842-9580356f6bc2): created successfully
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcded27-b52a-4a59-a8ad-e2088b00ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (08aa9322-1e6f-49b2-9151-1408da28e917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:08 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-309fd0a6-975e-41bf-aa4a-e5b46034ae0e tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Creating offline snapshot f13b5273-8f75-4795-a105-40da74fb2f56 of volume 78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c52e48-0a93-41dd-b438-5097439dea5d]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:08 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2
Sep 20 17:11:08 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:08 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2" returned: 0 in 0.367s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:08 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:09 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 1G
Sep 20 17:11:09 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:09 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 1G" returned: 0 in 0.460s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78588c7f-98fe-4e73-9842-9580356f6bc2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:09 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78588c7f-98fe-4e73-9842-9580356f6bc2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56
Sep 20 17:11:09 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:09 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78588c7f-98fe-4e73-9842-9580356f6bc2 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56" returned: 0 in 0.280s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:09 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 is being set with open permissions: ugo+rw
Sep 20 17:11:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:09 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56
Sep 20 17:11:09 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:09 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:09 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:10 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info
Sep 20 17:11:10 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:10 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:10 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info is being set with open permissions: ugo+rw
Sep 20 17:11:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:10 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info
Sep 20 17:11:10 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:10 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.info" returned: 0 in 0.355s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:10 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:10 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-cc2eed4b-a732-4d0a-9e6a-2a38936d8469 tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-f13b5273-8f75-4795-a105-40da74fb2f56-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-f13b5273-8f75-4795-a105-40da74fb2f56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-f13b5273-8f75-4795-a105-40da74fb2f56" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f13b5273-8f75-4795-a105-40da74fb2f56" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot f13b5273-8f75-4795-a105-40da74fb2f56 of volume 78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb7f35-5684-4c29-a961-33527b2375a3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:11 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56
Sep 20 17:11:11 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:12 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78588c7f-98fe-4e73-9842-9580356f6bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[703832b9-294a-4017-960b-e8741924e936]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:12 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2
Sep 20 17:11:12 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:12 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2" returned: 0 in 0.397s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:12 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:12 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56
Sep 20 17:11:12 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:13 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56" returned: 0 in 0.400s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:13 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56
Sep 20 17:11:13 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:13 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2.f13b5273-8f75-4795-a105-40da74fb2f56" returned: 0 in 0.260s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-f13b5273-8f75-4795-a105-40da74fb2f56" released by "_delete_snapshot" :: held 1.583s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" released by "delete_snapshot" :: held 1.607s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Created reservations ['ba2bee12-4948-4193-973f-c42f302c21b5', '60f0d7ca-8dcb-4ba8-8e1e-57f7a8d4b151', '636116f8-cc3f-406c-ab6e-cdad25407cc9', 'f9334647-d568-4305-b951-aa4f11297e47'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:13 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-333892bf-1c88-4458-8ea5-8446247b08e7 tempest-ProjectMemberTests-550205305 None] Lock "cinder-f13b5273-8f75-4795-a105-40da74fb2f56-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-78588c7f-98fe-4e73-9842-9580356f6bc2-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "cinder-78588c7f-98fe-4e73-9842-9580356f6bc2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:13 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" acquired by "delete_volume" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[76403287-3aed-42f9-83c2-d02747ec8515]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:14 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2
Sep 20 17:11:14 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:14 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2" returned: 0 in 0.400s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:14 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2
Sep 20 17:11:14 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:14 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-78588c7f-98fe-4e73-9842-9580356f6bc2" returned: 0 in 0.299s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-78588c7f-98fe-4e73-9842-9580356f6bc2" released by "delete_volume" :: held 0.775s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Created reservations ['9125347c-d8e1-4ee7-b84d-a65ee1649021', '9a9c2811-8c32-45fa-8fe1-14389af614e1', '6bf10ff2-a380-42b7-b296-c99b821641c1', '41ab1421-1e8d-4526-973a-0bbd48f49a4c'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:14 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:14 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:14 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:15 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.335s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:15 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8b2cc1ce-e182-4d8d-94c6-52a71a6e0683 tempest-ProjectMemberTests-550205305 None] Lock "cinder-78588c7f-98fe-4e73-9842-9580356f6bc2-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=178,cinder:INSERT=65,cinder:UPDATE=238,cinder:DELETE=15 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (f64130fb-d7a9-43a1-850b-94402c758690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9801ed5-e83f-4945-8dbb-b3abbce31822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9801ed5-e83f-4945-8dbb-b3abbce31822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904436505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8246941b-b146-4ef4-b8d9-daa2b8071f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:16Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a7c593-2e40-4c3e-8f62-ad34b1cf9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a7c593-2e40-4c3e-8f62-ad34b1cf9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9aac5d-4134-496d-bff5-e550dbcc1b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9aac5d-4134-496d-bff5-e550dbcc1b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8246941b-b146-4ef4-b8d9-daa2b8071f5f', 'volume_name': 'volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422f5f3-6fcd-4495-9a77-e5cd0189f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422f5f3-6fcd-4495-9a77-e5cd0189f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9596606-ef6a-4d04-a05c-411a76da7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:15 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Volume 8246941b-b146-4ef4-b8d9-daa2b8071f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f', 'volume_size': 1}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904436505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8246941b-b146-4ef4-b8d9-daa2b8071f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:16Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Creating volume 8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:15 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:15 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:15 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f 1073741824
Sep 20 17:11:15 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:16 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f 1073741824" returned: 0 in 0.479s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:INSERT=58,cinder:UPDATE=219,cinder:SELECT=172,cinder:DELETE=23 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:16 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f
Sep 20 17:11:16 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Flow 'volume_create_manager' (9d523b60-4f9d-4d83-9be6-74349eaa4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c10868a-8c47-4db6-85e7-fe162f1b1822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c10868a-8c47-4db6-85e7-fe162f1b1822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513015015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415fb642-bca9-40aa-8c28-736724f62d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1b3275364896b514fb90eddb9716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:17Z,use_quota=True,user_id='2fcf95350903426b8d4e53eb2cc1ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f015340-87cf-4d57-8462-d2adb51469df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f015340-87cf-4d57-8462-d2adb51469df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8362f9ae-1b1e-4d53-883e-9d689564579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8362f9ae-1b1e-4d53-883e-9d689564579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415fb642-bca9-40aa-8c28-736724f62d78', 'volume_name': 'volume-415fb642-bca9-40aa-8c28-736724f62d78', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39e981c-4033-43fb-b76c-bc45475bc6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39e981c-4033-43fb-b76c-bc45475bc6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c69e71c-737d-4a6d-be39-b67614cdf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Volume 415fb642-bca9-40aa-8c28-736724f62d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415fb642-bca9-40aa-8c28-736724f62d78', 'volume_size': 1}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f" returned: 0 in 0.294s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513015015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415fb642-bca9-40aa-8c28-736724f62d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1b3275364896b514fb90eddb9716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:17Z,use_quota=True,user_id='2fcf95350903426b8d4e53eb2cc1ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Creating volume 415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:16 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9596606-ef6a-4d04-a05c-411a76da7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 1073741824
Sep 20 17:11:16 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88d381e-ac7c-4349-9c87-360fdb3c25ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:16 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Volume volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f (8246941b-b146-4ef4-b8d9-daa2b8071f5f): created successfully
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88d381e-ac7c-4349-9c87-360fdb3c25ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:16 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (f64130fb-d7a9-43a1-850b-94402c758690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:16 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bece59a2-b87e-4ed8-9035-9bb0d3d2adc7 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:11:17 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 1073741824" returned: 0 in 0.431s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:17 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:17 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:17 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c69e71c-737d-4a6d-be39-b67614cdf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415fb642-bca9-40aa-8c28-736724f62d78', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b1cbe-5973-40e4-a14d-50e9868784fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:17 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Volume volume-415fb642-bca9-40aa-8c28-736724f62d78 (415fb642-bca9-40aa-8c28-736724f62d78): created successfully
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b1cbe-5973-40e4-a14d-50e9868784fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Flow 'volume_create_manager' (9d523b60-4f9d-4d83-9be6-74349eaa4537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:17 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-01ddd8b1-b931-4c95-b0b2-de95e26e5511 tempest-SnapshotDependencyTests-1753993037 None] Created volume successfully.
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:17 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Creating offline snapshot 0a6c9fec-60ca-4229-ba24-a4c5769b64c6 of volume 415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f8262-cab1-409c-a59e-6f5b8939b9de]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:18 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:18 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:18 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.381s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:18 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 1G
Sep 20 17:11:18 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:18 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 1G" returned: 0 in 0.413s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:18 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415fb642-bca9-40aa-8c28-736724f62d78 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:18 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415fb642-bca9-40aa-8c28-736724f62d78 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:18 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:19 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415fb642-bca9-40aa-8c28-736724f62d78 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.305s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:19 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 is being set with open permissions: ugo+rw
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:19 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:19 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:19 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:19 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info
Sep 20 17:11:19 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:19 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info" returned: 0 in 0.253s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:19 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info is being set with open permissions: ugo+rw
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:19 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info
Sep 20 17:11:19 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:19 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.info" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.894s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:19 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 3ec3bce8-feaf-466a-bfe0-6e4fae508a04 of volume 8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:20 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-13c578e4-6cd2-47fd-8101-f20aa8835527 tempest-SnapshotDependencyTests-1753993037 None] Create snapshot completed successfully
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff3aa6-f3c8-47ee-a561-1b7760423d39]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:20 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f
Sep 20 17:11:20 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:20 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f" returned: 0 in 0.368s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:20 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 1G
Sep 20 17:11:20 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:20 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 1G" returned: 0 in 0.406s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:20 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:20 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04
Sep 20 17:11:20 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:21 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04" returned: 0 in 0.313s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:21 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 is being set with open permissions: ugo+rw
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:21 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04
Sep 20 17:11:21 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:21 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:21 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info
Sep 20 17:11:21 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:21 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info" returned: 0 in 0.297s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:21 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info is being set with open permissions: ugo+rw
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:21 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info
Sep 20 17:11:21 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Flow 'volume_create_manager' (d394d38a-0df0-4f9b-81bb-0005fc60acee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab59ca-36dc-47b0-9c32-d8f52f2c8b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab59ca-36dc-47b0-9c32-d8f52f2c8b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9328a66-b705-4c34-ad76-223c0b107f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1b3275364896b514fb90eddb9716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a6c9fec-60ca-4229-ba24-a4c5769b64c6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:22Z,use_quota=True,user_id='2fcf95350903426b8d4e53eb2cc1ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a5c9fa-06f6-4d9a-ae87-02e8658985e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a5c9fa-06f6-4d9a-ae87-02e8658985e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c613472f-cd49-4be3-a861-b9ca6b56aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c613472f-cd49-4be3-a861-b9ca6b56aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9328a66-b705-4c34-ad76-223c0b107f2d', 'volume_name': 'volume-f9328a66-b705-4c34-ad76-223c0b107f2d', 'volume_size': 1, 'snapshot_id': '0a6c9fec-60ca-4229-ba24-a4c5769b64c6'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbfdfcf-130b-43b8-95c2-d85347aeb62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbfdfcf-130b-43b8-95c2-d85347aeb62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47136238-fbca-48fb-9629-3a20187b5046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:21 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Volume f9328a66-b705-4c34-ad76-223c0b107f2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9328a66-b705-4c34-ad76-223c0b107f2d', 'volume_size': 1, 'snapshot_id': '0a6c9fec-60ca-4229-ba24-a4c5769b64c6'}
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:21 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:21 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.info" returned: 0 in 0.257s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.146s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-f9328a66-b705-4c34-ad76-223c0b107f2d" by "_create_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-f9328a66-b705-4c34-ad76-223c0b107f2d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Creating volume f9328a66-b705-4c34-ad76-223c0b107f2d from snapshot 0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" by "_copy_volume_from_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] snapshot: 0a6c9fec-60ca-4229-ba24-a4c5769b64c6, volume: f9328a66-b705-4c34-ad76-223c0b107f2d,  {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 20 17:11:22 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-1abae99d-bb5a-430f-a54f-b4f25826ae4f tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa87af1-eaf0-4775-80fb-4fa2969650b4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:22 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:22 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-3ec3bce8-feaf-466a-bfe0-6e4fae508a04-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-3ec3bce8-feaf-466a-bfe0-6e4fae508a04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-3ec3bce8-feaf-466a-bfe0-6e4fae508a04" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3ec3bce8-feaf-466a-bfe0-6e4fae508a04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 3ec3bce8-feaf-466a-bfe0-6e4fae508a04 of volume 8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e0af8-f0ee-4145-b093-793519064fbd]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:22 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04
Sep 20 17:11:22 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:22 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.399s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-415fb642-bca9-40aa-8c28-736724f62d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Creating direct copy from snapshot {{(pid=85945) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63a9887-714d-45be-885b-3224911b9142]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:22 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:22 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:22 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04" returned: 0 in 0.388s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82a835-bffd-4e71-8f0a-21545a4397ad]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:22 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f
Sep 20 17:11:22 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:22 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.395s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG cinder.utils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Path /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d not found in is_blk_device check {{(pid=85945) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Sep 20 17:11:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:22 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d
Sep 20 17:11:22 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:23 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f" returned: 0 in 0.416s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:23 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04
Sep 20 17:11:23 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:23 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04" returned: 0 in 0.597s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:23 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:23 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04
Sep 20 17:11:23 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:24 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:24 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f.3ec3bce8-feaf-466a-bfe0-6e4fae508a04" returned: 0 in 0.414s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-3ec3bce8-feaf-466a-bfe0-6e4fae508a04" released by "_delete_snapshot" :: held 1.967s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" released by "delete_snapshot" :: held 1.996s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:24 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Created reservations ['bd2ebfa6-9918-4d5a-8055-e0fef4162330', '4b7cffb3-0dc3-4c6d-b8b3-c32e0aab2977', '59a28e88-a350-48ac-9412-c6ea387fed14', '01ccae7e-b245-4be9-8695-eaa99a1d58b4'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:24 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:11:24 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-23cfd483-8f6d-4c8d-a2a8-f9812d584420 tempest-ProjectMemberTests-550205305 None] Lock "cinder-3ec3bce8-feaf-466a-bfe0-6e4fae508a04-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-8246941b-b146-4ef4-b8d9-daa2b8071f5f-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "cinder-8246941b-b146-4ef4-b8d9-daa2b8071f5f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d48de-1368-4dec-bd56-dd46aed72bf9]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:25 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:25 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f
Sep 20 17:11:25 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:26 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f" returned: 0 in 0.622s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:26 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f
Sep 20 17:11:26 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:26 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-8246941b-b146-4ef4-b8d9-daa2b8071f5f" returned: 0 in 0.322s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-8246941b-b146-4ef4-b8d9-daa2b8071f5f" released by "delete_volume" :: held 1.066s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Created reservations ['495470b9-6fae-45cc-8a64-fe22add4c036', '253f16d5-e276-4b9d-9c8a-d7d0d123a8f9', '290c5fad-185f-4067-a779-6ac4bb44b89c', '1f7e400e-b6a3-4510-a5b3-2a5d51144231'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:26 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:27 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:27 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:27 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:27 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.399s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:27 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:27 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:11:27 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-bfa69a25-730f-452d-a962-f5fc6d7a6c16 tempest-ProjectMemberTests-550205305 None] Lock "cinder-8246941b-b146-4ef4-b8d9-daa2b8071f5f-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (b748b4ad-a989-47be-a306-58119426469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a19ea33-c2b0-4aa4-8e6a-211f208e9f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a19ea33-c2b0-4aa4-8e6a-211f208e9f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739937782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a75af-5606-4f9a-af89-333876d0ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:29Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58312431-942d-442c-a538-986febbb5ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58312431-942d-442c-a538-986febbb5ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867ef938-bc1b-4aba-aa59-a276e3da6424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867ef938-bc1b-4aba-aa59-a276e3da6424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0a75af-5606-4f9a-af89-333876d0ceb9', 'volume_name': 'volume-2b0a75af-5606-4f9a-af89-333876d0ceb9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0584301a-fc5b-421b-bfc9-02cb6e728281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0584301a-fc5b-421b-bfc9-02cb6e728281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c626620-79c9-4386-98e4-0a4e10207f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:28 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Volume 2b0a75af-5606-4f9a-af89-333876d0ceb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0a75af-5606-4f9a-af89-333876d0ceb9', 'volume_size': 1}
Sep 20 17:11:28 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:29 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d" returned: 0 in 6.655s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:29 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7c647-6600-4b9d-bf7b-9018909c1a0e]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:29 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:29 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:29 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:30 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.523s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.image.image_utils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d {{(pid=85945) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 20 17:11:30 devstack cinder-volume[85945]: INFO cinder.image.image_utils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Converted 1024.00 MB image at 153.86 MB/s
Sep 20 17:11:30 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d is being set with open permissions: ugo+rw
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:30 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d
Sep 20 17:11:30 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:30 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d" returned: 0 in 0.233s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" released by "_copy_volume_from_snapshot" :: held 8.308s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-f9328a66-b705-4c34-ad76-223c0b107f2d" released by "_create_volume_from_snapshot" :: held 8.342s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.361s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739937782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a75af-5606-4f9a-af89-333876d0ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:29Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Creating volume 2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:30 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:30 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 1073741824
Sep 20 17:11:30 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47136238-fbca-48fb-9629-3a20187b5046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9328a66-b705-4c34-ad76-223c0b107f2d', 'volume_size': 1, 'snapshot_id': '0a6c9fec-60ca-4229-ba24-a4c5769b64c6'}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0313774b-146c-4bb7-a69c-79b0fda94558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:30 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Volume volume-f9328a66-b705-4c34-ad76-223c0b107f2d (f9328a66-b705-4c34-ad76-223c0b107f2d): created successfully
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0313774b-146c-4bb7-a69c-79b0fda94558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Flow 'volume_create_manager' (d394d38a-0df0-4f9b-81bb-0005fc60acee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:30 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-25e7d742-431b-4cd0-bb3d-9a025c4fae29 tempest-SnapshotDependencyTests-1753993037 None] Created volume successfully.
Sep 20 17:11:30 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 1073741824" returned: 0 in 0.427s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:30 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:30 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9
Sep 20 17:11:30 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:31 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9" returned: 0 in 0.238s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c626620-79c9-4386-98e4-0a4e10207f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0a75af-5606-4f9a-af89-333876d0ceb9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d630a97f-9cff-4344-a4e0-8b901550aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:31 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Volume volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 (2b0a75af-5606-4f9a-af89-333876d0ceb9): created successfully
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d630a97f-9cff-4344-a4e0-8b901550aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (b748b4ad-a989-47be-a306-58119426469c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:31 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e2d5cb0d-005b-44e6-a480-0bfbe4d2c786 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Deleting offline snapshot 0a6c9fec-60ca-4229-ba24-a4c5769b64c6 of volume 415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] snapshot_file for this snap is: volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736b8c1-49b9-476e-84d0-a865c761c1c4]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:31 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:31 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:31 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.370s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-415fb642-bca9-40aa-8c28-736724f62d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c2ee70-7f1e-4fdd-92ed-35dca7a27ce8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 1820f3c5-0af1-42f9-ad34-05e55187644f of volume 2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0395cff2-a73c-4334-b4b5-bf0d6defd358]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:32 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9
Sep 20 17:11:32 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:32 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9" returned: 0 in 0.396s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f 1G
Sep 20 17:11:32 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6
Sep 20 17:11:32 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:32 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f 1G" returned: 0 in 0.408s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:32 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:32 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f
Sep 20 17:11:32 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:33 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78.0a6c9fec-60ca-4229-ba24-a4c5769b64c6" returned: 0 in 0.258s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-0a6c9fec-60ca-4229-ba24-a4c5769b64c6" released by "_delete_snapshot" :: held 1.444s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" released by "delete_snapshot" :: held 1.467s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Created reservations ['faa01c85-7182-476e-a8b1-3f6f9d4f09d5', '24fc07dc-077d-41c1-8982-0c3eff249286', 'd3e5303c-5d94-4035-9581-6860f7ddb732', 'c9a3391f-c17f-412f-87cb-4356830bd4b0'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:33 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Delete snapshot completed successfully.
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-7de4f30c-8af0-4a93-8bed-edfe90535f26 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-0a6c9fec-60ca-4229-ba24-a4c5769b64c6-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:33 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f" returned: 0 in 0.313s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:33 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f is being set with open permissions: ugo+rw
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:33 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f
Sep 20 17:11:33 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:33 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f" returned: 0 in 0.239s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:33 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info
Sep 20 17:11:33 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-415fb642-bca9-40aa-8c28-736724f62d78-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-415fb642-bca9-40aa-8c28-736724f62d78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:33 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info" returned: 0 in 0.262s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:33 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info is being set with open permissions: ugo+rw
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:33 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info
Sep 20 17:11:33 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aefb5f-5c8e-4bf8-950d-372d45594693]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:33 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:33 devstack sudo[107871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:33 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:34 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.info" returned: 0 in 0.252s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-269523d0-854c-456a-bc21-e934ed4d22fd tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-1820f3c5-0af1-42f9-ad34-05e55187644f-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:34 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-1820f3c5-0af1-42f9-ad34-05e55187644f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.393s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-1820f3c5-0af1-42f9-ad34-05e55187644f" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:34 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78
Sep 20 17:11:34 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-1820f3c5-0af1-42f9-ad34-05e55187644f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 1820f3c5-0af1-42f9-ad34-05e55187644f of volume 2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba1a2b-c17f-4ce0-9215-90db531a90a3]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:34 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f
Sep 20 17:11:34 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:34 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-415fb642-bca9-40aa-8c28-736724f62d78" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-415fb642-bca9-40aa-8c28-736724f62d78" released by "delete_volume" :: held 0.720s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Created reservations ['60fefd98-cd2e-4e50-9f7a-f734cbef9880', '27fdea6e-ef9a-4f19-bab0-1c1c3f1c0daa', 'c3f37acb-b2d8-4383-9736-7d94c02a5bfa', 'eae9e070-c8b9-4371-9539-6e5c75a2e69f'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:34 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:34 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:34 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f" returned: 0 in 0.404s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b0a75af-5606-4f9a-af89-333876d0ceb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cae07-8e0a-4e16-bc03-212b0c2c5914]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:34 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9
Sep 20 17:11:34 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-f9328a66-b705-4c34-ad76-223c0b107f2d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-f9328a66-b705-4c34-ad76-223c0b107f2d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:34 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.292s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:34 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Deleted volume successfully.
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-6d964a97-8952-4e1e-b05d-ae116dd27ced tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-415fb642-bca9-40aa-8c28-736724f62d78-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:34 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" acquired by "delete_volume" :: waited 0.021s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[066ac9d6-39e0-4c43-a129-aae124608128]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:35 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d
Sep 20 17:11:35 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:35 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9" returned: 0 in 0.407s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:35 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f
Sep 20 17:11:35 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:35 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d" returned: 0 in 0.362s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:35 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d
Sep 20 17:11:35 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:35 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:35 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f
Sep 20 17:11:35 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:35 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-f9328a66-b705-4c34-ad76-223c0b107f2d" returned: 0 in 0.254s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-quobyte-f9328a66-b705-4c34-ad76-223c0b107f2d" released by "delete_volume" :: held 0.661s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Created reservations ['e3fb0d4c-21e3-435f-899d-5b7129baef6c', 'f9b0d6c1-c58f-4008-95a6-a3cb1a97722e', 'a51541cb-35f7-4f6d-8da5-2fedbdc5c33c', '0612069a-15ff-4711-aa57-cd6034174018'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:35 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9.1820f3c5-0af1-42f9-ad34-05e55187644f" returned: 0 in 0.268s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:35 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:35 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-1820f3c5-0af1-42f9-ad34-05e55187644f" released by "_delete_snapshot" :: held 1.529s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" released by "delete_snapshot" :: held 1.553s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Created reservations ['26b35820-167b-42e5-ae0c-7113d78c887c', 'e7f3795e-a73c-4623-883f-b4b3e3fd78e1', '9aa18893-7a84-42ff-b799-c3e909d19cac', '38e51d09-8893-440c-8ff5-a7707522d0c7'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:35 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:11:35 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-958caf27-7d22-482f-9798-050256087b51 tempest-ProjectMemberTests-550205305 None] Lock "cinder-1820f3c5-0af1-42f9-ad34-05e55187644f-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.261s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:36 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Deleted volume successfully.
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-c4b6792e-54e7-4f4b-bce4-fdefab858035 tempest-SnapshotDependencyTests-1753993037 None] Lock "cinder-f9328a66-b705-4c34-ad76-223c0b107f2d-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-2b0a75af-5606-4f9a-af89-333876d0ceb9-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "cinder-2b0a75af-5606-4f9a-af89-333876d0ceb9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" acquired by "delete_volume" :: waited 0.026s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292b19f-a1cb-45a6-a4e9-df68ea0b3db8]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:36 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9
Sep 20 17:11:36 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:36 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9" returned: 0 in 0.406s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:36 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:36 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9
Sep 20 17:11:36 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:37 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-2b0a75af-5606-4f9a-af89-333876d0ceb9" returned: 0 in 0.249s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-2b0a75af-5606-4f9a-af89-333876d0ceb9" released by "delete_volume" :: held 0.717s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Created reservations ['f4c7aae2-8ab7-4ea8-bead-747dc792f7bc', '53c12133-a503-465b-b462-15fa66820922', '1bb65eca-8567-415d-95c1-5b54d00f0a57', '2d9630a6-8abe-43bd-9e7d-a224f9b4c627'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:37 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:37 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:37 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.284s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:37 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:11:37 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-ba1c4620-265a-482e-81b5-ac801d9d65de tempest-ProjectMemberTests-550205305 None] Lock "cinder-2b0a75af-5606-4f9a-af89-333876d0ceb9-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (fcc72442-b326-4fc3-89c5-5d2a8b5dc01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f1b39-a5e3-4dfd-b2e2-195047e26c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f1b39-a5e3-4dfd-b2e2-195047e26c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668938111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e5b4de-57c5-4975-b9ef-384b752834f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:38Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b83287-051f-4810-9deb-d9261ca7269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b83287-051f-4810-9deb-d9261ca7269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e1c779-c075-450c-8036-3e5541e2ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e1c779-c075-450c-8036-3e5541e2ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e5b4de-57c5-4975-b9ef-384b752834f9', 'volume_name': 'volume-55e5b4de-57c5-4975-b9ef-384b752834f9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f6bfa2-86de-4c10-b8a6-06791575037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f6bfa2-86de-4c10-b8a6-06791575037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1915e85c-2122-4370-aa0b-50aeb2dff308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Volume 55e5b4de-57c5-4975-b9ef-384b752834f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e5b4de-57c5-4975-b9ef-384b752834f9', 'volume_size': 1}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668938111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e5b4de-57c5-4975-b9ef-384b752834f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ec1c81e544ea5a5c42b5809803a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:38Z,use_quota=True,user_id='5add4d0436f040a097965033bb8fe5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Creating volume 55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:38 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:38 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 1073741824
Sep 20 17:11:38 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:38 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 1073741824" returned: 0 in 0.471s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:38 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9
Sep 20 17:11:38 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:38 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9" returned: 0 in 0.266s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1915e85c-2122-4370-aa0b-50aeb2dff308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e5b4de-57c5-4975-b9ef-384b752834f9', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db00476-8cfb-434f-8c72-4e8f7e4a3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:38 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Volume volume-55e5b4de-57c5-4975-b9ef-384b752834f9 (55e5b4de-57c5-4975-b9ef-384b752834f9): created successfully
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db00476-8cfb-434f-8c72-4e8f7e4a3816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:38 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Flow 'volume_create_manager' (fcc72442-b326-4fc3-89c5-5d2a8b5dc01e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:39 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-dff3b144-c228-4591-974e-d587e9526489 tempest-ProjectMemberTests-550205305 None] Created volume successfully.
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Creating offline snapshot 214ec43a-6ffe-48c0-8895-6cb8fa520227 of volume 55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abc89f6-417e-4e2a-9f8c-a572eece0787]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:40 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9
Sep 20 17:11:40 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:40 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9" returned: 0 in 0.375s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:40 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 1G {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:40 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 1G
Sep 20 17:11:40 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:41 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 1G" returned: 0 in 0.467s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5b4de-57c5-4975-b9ef-384b752834f9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:41 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5b4de-57c5-4975-b9ef-384b752834f9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227
Sep 20 17:11:41 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:41 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5b4de-57c5-4975-b9ef-384b752834f9 -F qcow2 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227" returned: 0 in 0.316s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:41 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 is being set with open permissions: ugo+rw
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:41 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227
Sep 20 17:11:41 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:41 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:41 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:41 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info
Sep 20 17:11:41 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:42 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info" returned: 0 in 0.251s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:42 devstack cinder-volume[85945]: WARNING cinder.volume.drivers.remotefs [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info is being set with open permissions: ugo+rw
Sep 20 17:11:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:42 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info
Sep 20 17:11:42 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:42 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.info" returned: 0 in 0.250s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:42 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:42 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-97a019f9-6100-4515-9c2f-6d3a22383a0a tempest-ProjectMemberTests-550205305 None] Create snapshot completed successfully
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-214ec43a-6ffe-48c0-8895-6cb8fa520227-delete_snapshot" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-214ec43a-6ffe-48c0-8895-6cb8fa520227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" by "delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-214ec43a-6ffe-48c0-8895-6cb8fa520227" by "_delete_snapshot" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-214ec43a-6ffe-48c0-8895-6cb8fa520227" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Deleting offline snapshot 214ec43a-6ffe-48c0-8895-6cb8fa520227 of volume 55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] snapshot_file for this snap is: volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e19f494-cf93-4279-83ad-371b0a25f616]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:43 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:43 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227
Sep 20 17:11:43 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:44 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227" returned: 0 in 0.389s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e5b4de-57c5-4975-b9ef-384b752834f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85945) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[756fe3cd-44cf-4bec-8368-68aeca8fe83c]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:44 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9
Sep 20 17:11:44 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:44 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9" returned: 0 in 0.417s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:44 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227
Sep 20 17:11:44 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:44 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227" returned: 0 in 0.357s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:44 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:45 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227
Sep 20 17:11:45 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:45 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9.214ec43a-6ffe-48c0-8895-6cb8fa520227" returned: 0 in 0.246s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-214ec43a-6ffe-48c0-8895-6cb8fa520227" released by "_delete_snapshot" :: held 1.518s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" released by "delete_snapshot" :: held 1.549s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Created reservations ['8093ede2-d061-4b47-b75c-ea496cad8ec5', 'be5296d7-2a46-4dbf-b38d-afe56f0385dc', 'b80a8d3d-fc49-477d-b9a4-fad5ede3a39f', 'afce4a0f-dec0-4165-a788-ba59f9f50e48'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:45 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Delete snapshot completed successfully.
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-8941b099-9b74-434f-a8de-e8c6837aa0c2 tempest-ProjectMemberTests-550205305 None] Lock "cinder-214ec43a-6ffe-48c0-8895-6cb8fa520227-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-55e5b4de-57c5-4975-b9ef-384b752834f9-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "cinder-55e5b4de-57c5-4975-b9ef-384b752834f9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Acquiring lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:45 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" acquired by "delete_volume" :: waited 0.018s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae44d15-b749-484e-86e5-8f7f90bbd833]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:46 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9
Sep 20 17:11:46 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:46 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9" returned: 0 in 0.439s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:46 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9
Sep 20 17:11:46 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:46 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-55e5b4de-57c5-4975-b9ef-384b752834f9" returned: 0 in 0.272s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "cinder-quobyte-55e5b4de-57c5-4975-b9ef-384b752834f9" released by "delete_volume" :: held 0.785s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Created reservations ['cf9830aa-47ab-4c0d-a6d2-17ac52f746ee', '3ea56fe4-2354-4768-9999-8d477885d57b', '4ff3ac0b-33c0-4dc0-a602-81e11baea0a4', 'f7ec79f3-ba39-4136-b02a-e374bb7ea634'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:46 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:46 devstack sudo[107989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:46 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:47 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:47 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.248s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:47 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:47 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Deleted volume successfully.
Sep 20 17:11:47 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-5b50c0bf-e990-48d8-8c21-411827c9ea2b tempest-ProjectMemberTests-550205305 None] Lock "cinder-55e5b4de-57c5-4975-b9ef-384b752834f9-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Flow 'volume_create_manager' (a0bc8106-ba44-4b00-b63a-8bf84e2a3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d02db-42c9-4fad-9419-1697c8b19bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d02db-42c9-4fad-9419-1697c8b19bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221238137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bae19c-77d2-4ace-a214-e33e5d858a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305fec20100f4a80943319082970f8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:50Z,use_quota=True,user_id='d74b7168e179441a91102c6215f11910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f15b64e-aa77-44e5-8f93-05efdc863dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f15b64e-aa77-44e5-8f93-05efdc863dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0713cff9-72d5-4c10-8065-8f539988baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0713cff9-72d5-4c10-8065-8f539988baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bae19c-77d2-4ace-a214-e33e5d858a28', 'volume_name': 'volume-63bae19c-77d2-4ace-a214-e33e5d858a28', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfeb9eb-c952-4740-896c-5b6c67ccbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfeb9eb-c952-4740-896c-5b6c67ccbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b062f7fa-62ea-4da5-b24d-183a95e4b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:50 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Volume 63bae19c-77d2-4ace-a214-e33e5d858a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bae19c-77d2-4ace-a214-e33e5d858a28', 'volume_size': 1}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221238137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bae19c-77d2-4ace-a214-e33e5d858a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305fec20100f4a80943319082970f8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:50Z,use_quota=True,user_id='d74b7168e179441a91102c6215f11910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Creating volume 63bae19c-77d2-4ace-a214-e33e5d858a28 {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:50 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:50 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 1073741824
Sep 20 17:11:50 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:50 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 1073741824" returned: 0 in 0.378s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:50 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:50 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28
Sep 20 17:11:50 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:51 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28" returned: 0 in 0.232s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b062f7fa-62ea-4da5-b24d-183a95e4b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bae19c-77d2-4ace-a214-e33e5d858a28', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a15317f-819d-4590-9fd8-50be2c0f36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:51 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Volume volume-63bae19c-77d2-4ace-a214-e33e5d858a28 (63bae19c-77d2-4ace-a214-e33e5d858a28): created successfully
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a15317f-819d-4590-9fd8-50be2c0f36db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Flow 'volume_create_manager' (a0bc8106-ba44-4b00-b63a-8bf84e2a3811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:51 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-8cacc5b1-701a-49d0-9753-16f2d63f3b68 tempest-ProjectReaderTests-1007287205 None] Created volume successfully.
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Acquiring lock "cinder-63bae19c-77d2-4ace-a214-e33e5d858a28-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "cinder-63bae19c-77d2-4ace-a214-e33e5d858a28-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Acquiring lock "cinder-quobyte-63bae19c-77d2-4ace-a214-e33e5d858a28" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "cinder-quobyte-63bae19c-77d2-4ace-a214-e33e5d858a28" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f25832-e810-42b3-b88e-0eb7a7acdb8a]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:51 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:51 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28
Sep 20 17:11:51 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:52 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28" returned: 0 in 0.338s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:52 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28
Sep 20 17:11:52 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:52 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-63bae19c-77d2-4ace-a214-e33e5d858a28" returned: 0 in 0.230s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "cinder-quobyte-63bae19c-77d2-4ace-a214-e33e5d858a28" released by "delete_volume" :: held 0.604s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Created reservations ['db2f5601-22a5-4e32-98eb-febbee78ca8b', 'fb4ee452-13bc-480f-ade8-2b8f414e7414', '25c6848f-efa6-428f-a653-384a7de1ec38', 'f5c02d63-5066-4444-9d6f-dee7f9c77c7d'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:52 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:52 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:52 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.225s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:52 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Deleted volume successfully.
Sep 20 17:11:52 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-a5b23de1-6761-4ec3-b60b-c039fb05ee1e tempest-ProjectReaderTests-1007287205 None] Lock "cinder-63bae19c-77d2-4ace-a214-e33e5d858a28-delete_volume" released by "delete_volume" :: held 1.003s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.flows.manager.create_volume [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85945) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Flow 'volume_create_manager' (1ca530b5-0f91-4ae8-b2e2-5863dd81cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f3b3f8-8973-4831-b0b2-2e76bdac487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f3b3f8-8973-4831-b0b2-2e76bdac487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598938320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11733959-ee1e-478b-9b74-11e626a4f86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305fec20100f4a80943319082970f8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:53Z,use_quota=True,user_id='d74b7168e179441a91102c6215f11910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d377ffa6-a224-4681-a942-a1f39abb1629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d377ffa6-a224-4681-a942-a1f39abb1629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1f927-7afb-4291-ac5a-4579529add36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1f927-7afb-4291-ac5a-4579529add36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11733959-ee1e-478b-9b74-11e626a4f86d', 'volume_name': 'volume-11733959-ee1e-478b-9b74-11e626a4f86d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79e607-051c-4980-a70b-ed79dd950ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79e607-051c-4980-a70b-ed79dd950ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba5f520-85f1-45fe-a34e-2a854b2acb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Volume 11733959-ee1e-478b-9b74-11e626a4f86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11733959-ee1e-478b-9b74-11e626a4f86d', 'volume_size': 1}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e01a0653650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-20T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598938320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11733959-ee1e-478b-9b74-11e626a4f86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305fec20100f4a80943319082970f8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-20T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-20T15:11:53Z,use_quota=True,user_id='d74b7168e179441a91102c6215f11910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ca55c8-066c-453e-8878-276e2d5eb54f),volume_type_id=b1ca55c8-066c-453e-8878-276e2d5eb54f)}" {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.remotefs [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Creating volume 11733959-ee1e-478b-9b74-11e626a4f86d {{(pid=85945) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Selected osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6 as target Quobyte volume. {{(pid=85945) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 20 17:11:53 devstack cinder-volume[85945]: INFO cinder.volume.drivers.remotefs [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] casted to osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d 1073741824 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:53 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d 1073741824
Sep 20 17:11:53 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:53 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d 1073741824" returned: 0 in 0.386s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:53 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d
Sep 20 17:11:53 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:53 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d" returned: 0 in 0.229s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] <== create_volume: return (651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'} {{(pid=85945) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba5f520-85f1-45fe-a34e-2a854b2acb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11733959-ee1e-478b-9b74-11e626a4f86d', 'volume_size': 1}' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895bd579-17d2-46dc-bf05-551890178207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 20 17:11:53 devstack cinder-volume[85945]: INFO cinder.volume.flows.manager.create_volume [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Volume volume-11733959-ee1e-478b-9b74-11e626a4f86d (11733959-ee1e-478b-9b74-11e626a4f86d): created successfully
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895bd579-17d2-46dc-bf05-551890178207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85945) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 20 17:11:53 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Flow 'volume_create_manager' (1ca530b5-0f91-4ae8-b2e2-5863dd81cf86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85945) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 20 17:11:53 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-45581d8f-de76-4b6d-8865-2e59893e0012 tempest-ProjectReaderTests-1007287205 None] Created volume successfully.
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Acquiring lock "cinder-11733959-ee1e-478b-9b74-11e626a4f86d-delete_volume" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "cinder-11733959-ee1e-478b-9b74-11e626a4f86d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Acquiring lock "cinder-quobyte-11733959-ee1e-478b-9b74-11e626a4f86d" by "delete_volume" {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "cinder-quobyte-11733959-ee1e-478b-9b74-11e626a4f86d" acquired by "delete_volume" :: waited 0.013s {{(pid=85945) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27cab4-774c-4202-b3a2-a6403cb45430]: (4, 'qcow2') {{(pid=87279) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:54 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d
Sep 20 17:11:54 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:54 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d" returned: 0 in 0.341s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:54 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d
Sep 20 17:11:54 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:54 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355/volume-11733959-ee1e-478b-9b74-11e626a4f86d" returned: 0 in 0.227s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "cinder-quobyte-11733959-ee1e-478b-9b74-11e626a4f86d" released by "delete_volume" :: held 0.608s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.quota [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Created reservations ['595c2c5d-c4aa-4ed1-ae27-ca2009ccf25f', '0a4e0877-60e9-44be-96f7-4620ad5aa610', 'acf6787d-b0df-43ea-84f8-8df504ad7ff1', '6340054c-421b-4b52-b84f-27ff3dce02f1'] {{(pid=85945) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:54 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:54 devstack sudo[108029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:54 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:55 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:55 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.226s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:55 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:55 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Deleted volume successfully.
Sep 20 17:11:55 devstack cinder-volume[85945]: DEBUG cinder.coordination [None req-e46f8673-2104-422c-9760-caea2a72bcda tempest-ProjectReaderTests-1007287205 None] Lock "cinder-11733959-ee1e-478b-9b74-11e626a4f86d-delete_volume" released by "delete_volume" :: held 1.005s {{(pid=85945) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6': None} {{(pid=85945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG cinder.volume.drivers.quobyte [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78ed38c1-ae19-4111-ba4f-44f0f755d5e6'] {{(pid=85945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355 {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 20 17:11:58 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355
Sep 20 17:11:58 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 20 17:11:58 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_concurrency.processutils [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b61ae5302c2d258f9c3d302faaa1355" returned: 0 in 0.240s {{(pid=85945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG cinder.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Notifying Schedulers of capabilities ... {{(pid=85945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG oslo_service.periodic_task [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] Running periodic task VolumeManager._thread_info {{(pid=85945) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread count: 28 {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 20 17:11:58 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-cd9135f2-4457-474f-b2c2-5cdf6b0b585b None None] thread info: [<_MainThread(MainThread, started 138545563779200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138545464990528)>, <Thread(Thread-3 (stat_writer), started daemon 138545448744128)>, <Thread(Rabbit-heartbeat, started daemon 138545449527808)>, <Thread(Thread-5 (_runner), started daemon 138545449613056)>, <Thread(Thread-7 (_runner), started daemon 138545447598976)>, <Thread(fd_logger, started daemon 138545445713024)>, <Thread(privsep_reader, started daemon 138545449628736)>, <Thread(tpool_thread_0, started daemon 138545439033024)>, <Thread(tpool_thread_1, started daemon 138545430640320)>, <Thread(tpool_thread_2, started daemon 138545422231232)>, <Thread(tpool_thread_3, started daemon 138545413822144)>, <Thread(tpool_thread_4, started daemon 138545405413056)>, <Thread(tpool_thread_5, started daemon 138545397003968)>, <Thread(tpool_thread_6, started daemon 138545388594880)>, <Thread(tpool_thread_7, started daemon 138545380185792)>, <Thread(tpool_thread_8, started daemon 138545371776704)>, <Thread(tpool_thread_9, started daemon 138545363367616)>, <Thread(tpool_thread_10, started daemon 138545354958528)>, <Thread(tpool_thread_11, started daemon 138545346549440)>, <Thread(tpool_thread_12, started daemon 138545338140352)>, <Thread(tpool_thread_13, started daemon 138545329731264)>, <Thread(tpool_thread_14, started daemon 138545321322176)>, <Thread(tpool_thread_15, started daemon 138545312913088)>, <Thread(tpool_thread_16, started daemon 138545304504000)>, <Thread(tpool_thread_17, started daemon 138545296094912)>, <Thread(tpool_thread_18, started daemon 138545287685824)>, <Thread(tpool_thread_19, started daemon 138545279276736)>] {{(pid=85945) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 20 17:12:04 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:UPDATE=110,cinder:SELECT=82,cinder:INSERT=28,cinder:DELETE=8 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 20 17:12:05 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writing DB stats cinder:SELECT=75,cinder:UPDATE=98,cinder:DELETE=10,cinder:INSERT=26 {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}